tencent cloud

Data Lake Compute

製品概要
プロダクト概要
製品の強み
適用シーン
購入ガイド
課金概要
返金説明
支払い期限切れ説明
設定調整費用の説明
クイックスタート
新規ユーザー開通フルプロセス
DLC データインポートガイド
DLCデータ分析の1分間入門
DLC権限管理の1分間入門
パーティションテーブル1分間入門
データ最適化をオンにする
クロスソース分析 EMR Hive データ
標準エンジン構成ガイド
操作ガイド
コンソール操作紹介
開発ガイド
実行環境
SparkJar ジョブ開発ガイド
PySparkジョブ開発ガイド
「クエリパフォーマンス最適化ガイド」
UDF 関数開発ガイド
システム制約
クライアントアクセス
JDBCアクセス
TDLC コマンドラインツールにアクセス
サードパーティソフトウェア連携
Python にアクセス
実践チュートリアル
DLC を Power BI に接続
テーブル作成の実践
Apache Airflowを使用してDLCエンジンのタスクをスケジュールして送信する
StarRocks は DLC 内部ストレージを直接クエリします
Spark の計算コスト最適化プラクティス
DATA + AI
ロールSSOを使用してDLCにアクセスする
SQL構文
SuperSQL構文
標準 Spark 構文概要
標準 Presto 構文の概要
予約語
API Documentation
History
Introduction
API Category
Making API Requests
Data Table APIs
Task APIs
Metadata APIs
Service Configuration APIs
Permission Management APIs
Database APIs
Data Source Connection APIs
Data Optimization APIs
Data Engine APIs
Resource Group for the Standard Engine APIs
Data Types
Error Codes
一般クラスリファレンス
エラーコード
クォータと制限
サードパーティソフトウェアでDLCに接続する操作ガイド
よくあるご質問
権限に関するよくあるご質問
エンジン類のよくある質問
機能に関するよくあるご質問
Sparkジョブクラスに関するよくある質問
DLC ポリシー
プライバシーポリシー
データプライバシーとセキュリティ契約
お問い合わせ

スタンダード S1.1 実行環境

フォーカスモード
フォントサイズ
最終更新日: 2025-12-25 10:52:26

システム環境

OS:TencentOS Server 3.1 (Final)
Java:TencentKonaJDK 11.0.28+1
Scala:2.12.18
Python:3.9.20

イメージに組み込まれた依存ライブラリ

インストール済みのJavaおよびScalaライブラリ


activation-1.1.1.jar
aircompressor-0.27.jar
algebra_2.12-2.0.1.jar
aliyun-java-sdk-core-4.5.10.jar
aliyun-java-sdk-kms-2.11.0.jar
aliyun-java-sdk-ram-3.1.0.jar
aliyun-sdk-oss-3.13.0.jar
alluxio-core-client-ext-2.9.3-tq-1.1.9.jar
alluxio-shaded-client-2.10.0-20231107.094109-1.jar
amoro-format-mixed-spark-runtime-3.5-0.8.0.3.jar
annotations-17.0.0.jar
antlr4-runtime-4.9.3.jar
antlr-runtime-3.5.2.jar
aopalliance-repackaged-2.6.1.jar
argparse4j-0.7.0.jar
arpack-3.0.3.jar
arpack_combined_all-0.1.jar
arrow-format-12.0.1.jar
arrow-memory-core-12.0.1.jar
arrow-memory-netty-12.0.1.jar
arrow-vector-12.0.1.jar
audience-annotations-0.5.0.jar
avro-1.11.2.jar
avro-ipc-1.11.2.jar
avro-mapred-1.11.2.jar
aws-java-sdk-bundle-1.11.1026.jar
azure-data-lake-store-sdk-2.3.9.jar
azure-keyvault-core-1.0.0.jar
azure-storage-7.0.1.jar
blas-3.0.3.jar
bonecp-0.8.0.RELEASE.jar
breeze_2.12-2.1.0.jar
breeze-macros_2.12-2.1.0.jar
caffeine-2.8.0.jar
cats-kernel_2.12-2.1.1.jar
chdfs_hadoop_plugin_network-2.8.jar
checker-qual-2.10.0.jar
chill_2.12-0.10.0.jar
chill-java-0.10.0.jar
commons-cli-1.5.0.jar
commons-codec-1.16.1.jar
commons-collections-3.2.2.jar
commons-collections4-4.4.jar
commons-compiler-3.1.9.jar
commons-compress-1.23.0.jar
commons-crypto-1.1.0.jar
commons-dbcp-1.4.jar
commons-httpclient-3.0.1.jar
commons-io-2.16.1.jar
commons-lang-2.6.jar
commons-lang3-3.12.0.jar
commons-logging-1.1.3.jar
commons-math3-3.6.1.jar
commons-pool-1.5.4.jar
commons-pool2-2.11.1.jar
commons-text-1.10.0.jar
compress-lzf-1.1.2.jar
cos_api-bundle-5.6.244.4.jar
cosn-ranger-interface-1.0.3.jar
curator-client-2.13.0.jar
curator-framework-2.13.0.jar
curator-recipes-2.13.0.jar
datanucleus-api-jdo-4.2.4.jar
datanucleus-core-4.1.17.jar
datanucleus-rdbms-4.1.19.jar
datasketches-java-3.3.0.jar
datasketches-memory-2.1.0.jar
derby-10.14.2.0.jar
dlc-serde-1.0.1.jar
dlc-spark-lineage-spark35-1.0.2.jar
dropwizard-metrics-hadoop-metrics2-reporter-0.1.2.jar
error_prone_annotations-2.3.3.jar
file-level-sasm-3.5.1-dlc-merging-1.0.2.jar
flatbuffers-java-1.12.0.jar
gcs-connector-hadoop3-2.2.14-shaded.jar
geotools-wrapper-1.6.1-28.2.jar
goosefs-client-1.4.2.jar
gson-2.2.4.jar
guava-14.0.1.jar
hadoop-aliyun-3.3.2.jar
hadoop-annotations-3.3.2.jar
hadoop-aws-3.3.2.jar
hadoop-azure-3.3.2.jar
hadoop-azure-datalake-3.3.2.jar
hadoop-client-api-3.3.2.jar
hadoop-client-runtime-3.3.2.jar
hadoop-cloud-storage-3.3.2.jar
hadoop-cos-8.3.22-dlc-m315.jar
hadoop-lzo-0.4.20.jar
hadoop-openstack-3.3.2.jar
hadoop-shaded-guava-1.1.1.jar
hbase-client-2.3.5.jar
hbase-common-2.3.5.jar
hbase-protocol-shaded-2.3.5.jar
hbase-shaded-mapreduce-2.3.5.jar
hbase-shaded-miscellaneous-3.3.0.jar
hbase-shaded-netty-3.3.0.jar
hbase-shaded-protobuf-3.3.0.jar
hbase-spark-1.0.1-3.2.1-2261.jar
hbase-spark-protocol-1.0.1-3.2.1-2261.jar
hbase-spark-protocol-shaded-1.0.1-3.2.1-2261.jar
HikariCP-2.5.1.jar
hive-beeline-2.3.7-dlc-226.jar
hive-cli-2.3.7-dlc-226.jar
hive-common-2.3.7-dlc-226.jar
hive-exec-2.3.7-dlc-226-core.jar
hive-hcatalog-core-2.3.7-dlc-226.jar
hive-jdbc-2.3.7-dlc-226.jar
hive-llap-common-2.3.7-dlc-226.jar
hive-metastore-2.3.7-dlc-226.jar
hive-serde-2.3.7-dlc-226.jar
hive-service-rpc-3.1.3.jar
hive-shims-0.23-2.3.7-dlc-226.jar
hive-shims-2.3.7-dlc-226.jar
hive-shims-common-2.3.7-dlc-226.jar
hive-shims-scheduler-2.3.7-dlc-226.jar
hive-storage-api-2.8.1.jar
hk2-api-2.6.1.jar
hk2-locator-2.6.1.jar
hk2-utils-2.6.1.jar
htrace-core4-4.1.0-incubating.jar
httpclient-4.5.14.jar
httpcore-4.4.16.jar
iceberg-extend-f2.9.5.rc0.jar
iceberg-spark-runtime-3.5_2.12-1.5.0-t281.3-tencent.jar
ini4j-0.5.4.jar
istack-commons-runtime-3.0.8.jar
ivy-2.5.1.jar
jackson-annotations-2.15.2.jar
jackson-core-2.15.2.jar
jackson-core-asl-1.9.13.jar
jackson-databind-2.15.2.jar
jackson-dataformat-cbor-2.15.2.jar
jackson-dataformat-csv-2.10.5.jar
jackson-dataformat-yaml-2.15.2.jar
jackson-datatype-jdk8-2.10.5.jar
jackson-datatype-jsr310-2.15.2.jar
jackson-mapper-asl-1.9.13.jar
jackson-module-scala_2.12-2.15.2.jar
jakarta.annotation-api-1.3.5.jar
jakarta.inject-2.6.1.jar
jakarta.servlet-api-4.0.3.jar
jakarta.validation-api-2.0.2.jar
jakarta.ws.rs-api-2.1.6.jar
jakarta.xml.bind-api-2.3.2.jar
janino-3.1.9.jar
javassist-3.29.2-GA.jar
javax.jdo-3.2.0-m3.jar
javolution-5.5.1.jar
jaxb-api-2.2.11.jar
jaxb-runtime-2.3.2.jar
jcl-over-slf4j-2.0.7.jar
jdo-api-3.0.1.jar
jdom2-2.0.6.jar
jersey-client-2.40.jar
jersey-common-2.40.jar
jersey-container-servlet-2.40.jar
jersey-container-servlet-core-2.40.jar
jersey-hk2-2.40.jar
jersey-server-2.40.jar
jettison-1.1.jar
jetty-util-9.4.54.v20240208.jar
jetty-util-ajax-9.4.54.v20240208.jar
JLargeArrays-1.5.jar
jline-2.14.6.jar
job-level-sasm-3.5.1-dlc-merging-1.0.2.jar
joda-time-2.12.5.jar
jodd-core-3.5.2.jar
jopt-simple-5.0.4.jar
jpam-1.1.jar
json-1.8.jar
json4s-ast_2.12-3.7.0-M11.jar
json4s-core_2.12-3.7.0-M11.jar
json4s-jackson_2.12-3.7.0-M11.jar
json4s-scalap_2.12-3.7.0-M11.jar
json-serde-1.3.8-jar-with-dependencies.jar
jsr305-3.0.0.jar
jta-1.1.jar
JTransforms-3.1.jar
jul-to-slf4j-2.0.7.jar
kafka_2.12-2.8.0.jar
kafka-clients-2.8.0.jar
kafka-metadata-2.8.0.jar
kafka-raft-2.8.0.jar
kryo-shaded-4.0.2.jar
kubernetes-client-6.7.2.jar
kubernetes-client-api-6.7.2.jar
kubernetes-httpclient-okhttp-6.7.2.jar
kubernetes-model-admissionregistration-6.7.2.jar
kubernetes-model-apiextensions-6.7.2.jar
kubernetes-model-apps-6.7.2.jar
kubernetes-model-autoscaling-6.7.2.jar
kubernetes-model-batch-6.7.2.jar
kubernetes-model-certificates-6.7.2.jar
kubernetes-model-common-6.7.2.jar
kubernetes-model-coordination-6.7.2.jar
kubernetes-model-core-6.7.2.jar
kubernetes-model-discovery-6.7.2.jar
kubernetes-model-events-6.7.2.jar
kubernetes-model-extensions-6.7.2.jar
kubernetes-model-flowcontrol-6.7.2.jar
kubernetes-model-gatewayapi-6.7.2.jar
kubernetes-model-metrics-6.7.2.jar
kubernetes-model-networking-6.7.2.jar
kubernetes-model-node-6.7.2.jar
kubernetes-model-policy-6.7.2.jar
kubernetes-model-rbac-6.7.2.jar
kubernetes-model-resource-6.7.2.jar
kubernetes-model-scheduling-6.7.2.jar
kubernetes-model-storageclass-6.7.2.jar
kyuubi-spark-authz_2.12-1.7.0-f295.jar
kyuubi-spark-sql-engine_2.12-1.8.1-20250610.111909-40.jar
lakefs-cosn-client-t2.8.1.jar
lapack-3.0.3.jar
leveldbjni-all-1.8.jar
libfb303-0.9.3.jar
libthrift-0.12.0.jar
livy-api-v0.8.0-dlc-m315.jar
livy-core_2.12-v0.8.0-dlc-m315.jar
livy-repl_2.12-v0.8.0-dlc-m315.jar
livy-rsc-v0.8.0-dlc-m315.jar
log4j-1.2-api-2.20.0.jar
log4j-api-2.20.0.jar
log4j-core-2.20.0.jar
log4j-slf4j2-impl-2.20.0.jar
logging-interceptor-3.12.12.jar
lz4-java-1.8.0.jar
metrics-core-2.2.0.jar
metrics-core-4.2.19.jar
metrics-graphite-4.2.19.jar
metrics-jmx-4.2.19.jar
metrics-json-4.2.19.jar
metrics-jvm-4.2.19.jar
minlog-1.3.0.jar
mysql-connector-j-8.0.33.jar
netty-all-4.1.96.Final.jar
netty-buffer-4.1.96.Final.jar
netty-codec-4.1.96.Final.jar
netty-codec-http2-4.1.96.Final.jar
netty-codec-http-4.1.96.Final.jar
netty-codec-socks-4.1.96.Final.jar
netty-common-4.1.96.Final.jar
netty-handler-4.1.96.Final.jar
netty-handler-proxy-4.1.96.Final.jar
netty-resolver-4.1.96.Final.jar
netty-transport-4.1.96.Final.jar
netty-transport-classes-epoll-4.1.96.Final.jar
netty-transport-classes-kqueue-4.1.96.Final.jar
netty-transport-native-epoll-4.1.96.Final-linux-aarch_64.jar
netty-transport-native-epoll-4.1.96.Final-linux-x86_64.jar
netty-transport-native-kqueue-4.1.96.Final-osx-aarch_64.jar
netty-transport-native-kqueue-4.1.96.Final-osx-x86_64.jar
netty-transport-native-unix-common-4.1.96.Final.jar
objenesis-3.3.jar
okhttp-3.12.12.jar
okio-1.17.6.jar
opencsv-2.3.jar
opentracing-api-0.33.0.jar
opentracing-noop-0.33.0.jar
opentracing-util-0.33.0.jar
orc-core-1.9.4-shaded-protobuf.jar
orc-mapreduce-1.9.4-shaded-protobuf.jar
orc-shims-1.9.4.jar
oro-2.0.8.jar
osgi-resource-locator-1.0.3.jar
paranamer-2.8.jar
parquet-column-1.13.1.jar
parquet-common-1.13.1.jar
parquet-encoding-1.13.1.jar
parquet-format-structures-1.13.1.jar
parquet-hadoop-1.13.1.jar
parquet-jackson-1.13.1.jar
pickle-1.3.jar
polaris-factory-shaded-3.3.7.jar
postgresql-42.2.19.jar
py4j-0.10.9.7.jar
RoaringBitmap-0.9.45.jar
rocksdbjni-8.3.2.jar
scala-collection-compat_2.12-2.7.0.jar
scala-compiler-2.12.18.jar
scala-java8-compat_2.12-0.9.1.jar
scala-library-2.12.18.jar
scala-logging_2.12-3.9.2.jar
scala-parser-combinators_2.12-2.3.0.jar
scala-reflect-2.12.18.jar
scala-xml_2.12-2.1.0.jar
sedona-spark-shaded-3.5_2.12-1.6.1-202408.jar
shims-0.9.45.jar
slf4j-api-2.0.7.jar
slf4j-log4j12-1.7.9.jar
snakeyaml-2.0.jar
snakeyaml-engine-2.6.jar
snappy-java-1.1.10.5.jar
spark-analysis-listener-common-1.0.1.jar
spark-analysis-listener-core-1.0.9.jar
spark-avro_2.12-3.5.3-dlc.jar
spark-catalog-plugins-release-dlc-3.5.3-m315.jar
spark-catalyst_2.12-3.5.3-dlc.jar
spark-common-utils_2.12-3.5.3-dlc.jar
spark-core_2.12-3.5.3-dlc.jar
spark-doris-connector-3.1_2.12-1.3.1-dlc-f280.jar
spark-graphx_2.12-3.5.3-dlc.jar
spark-hadoop-cloud_2.12-3.5.3-dlc.jar
spark-hive_2.12-3.5.3-dlc.jar
spark-hive-thriftserver_2.12-3.5.3-dlc.jar
spark-kubernetes_2.12-3.5.3-dlc.jar
spark-kvstore_2.12-3.5.3-dlc.jar
spark-launcher_2.12-3.5.3-dlc.jar
spark-mllib_2.12-3.5.3-dlc.jar
spark-mllib-local_2.12-3.5.3-dlc.jar
spark-network-common_2.12-3.5.3-dlc.jar
spark-network-shuffle_2.12-3.5.3-dlc.jar
spark-repl_2.12-3.5.3-dlc.jar
spark-sketch_2.12-3.5.3-dlc.jar
spark-sql_2.12-3.5.3-dlc.jar
spark-sql-api_2.12-3.5.3-dlc.jar
spark-sql-executor-1.0.1.jar
spark-sql-kafka-0-10_2.12-3.5.3-dlc.jar
spark-streaming_2.12-3.5.3-dlc.jar
spark-streaming-kafka-0-10_2.12-3.5.3-dlc.jar
spark-tags_2.12-3.5.3-dlc.jar
spark-token-provider-kafka-0-10_2.12-3.5.3-dlc.jar
spark-unsafe_2.12-3.5.3-dlc.jar
spire_2.12-0.17.0.jar
spire-macros_2.12-0.17.0.jar
spire-platform_2.12-0.17.0.jar
spire-util_2.12-0.17.0.jar
ST4-4.0.4.jar
stax-api-1.0.1.jar
stream-2.9.6.jar
super-csv-2.2.0.jar
task-level-sasm-3.5.1-dlc-merging-1.0.2.jar
tdsql-pg-connector-java8-1.1.3.jar
threeten-extra-1.7.1.jar
tink-1.9.0.jar
transaction-api-1.1.jar
univocity-parsers-2.9.1.jar
wildfly-openssl-1.0.7.Final.jar
xbean-asm9-shaded-4.23.jar
xz-1.9.jar
zjsonpatch-0.3.0.jar
zookeeper-3.6.3.jar
zookeeper-jute-3.6.3.jar
zstd-jni-1.5.5-4.jar

インストール済みのPythonライブラリ

Package Version
---------------------------------- --------------
aiohappyeyeballs 2.6.1
aiohttp 3.11.2
aiosignal 1.4.0
alembic 1.16.5
anyio 4.10.0
argon2-cffi 25.1.0
argon2-cffi-bindings 25.1.0
arrow 1.3.0
asttokens 3.0.0
async-lru 2.0.5
async-timeout 5.0.1
attrs 25.3.0
babel 2.17.0
beautifulsoup4 4.13.5
bleach 6.2.0
blinker 1.9.0
cachetools 5.5.2
certifi 2025.8.3
cffi 2.0.0
charset-normalizer 3.4.3
click 8.1.8
cloudpickle 3.1.1
comm 0.2.3
confluent-kafka 2.11.1
contourpy 1.3.0
cos_python_sdk_v5 1.9.38
coscmd 1.9.0.6
crcmod 1.7
cycler 0.12.1
databricks-sdk 0.66.0
DateTime 5.5
debugpy 1.8.17
decorator 5.2.1
defusedxml 0.7.1
dlcmagic 1.0.8.post2
docker 7.1.0
exceptiongroup 1.3.0
executing 2.2.1
fastjsonschema 2.21.2
Flask 3.1.2
fonttools 4.60.0
fqdn 1.5.1
frozenlist 1.7.0
gitdb 4.0.12
GitPython 3.1.45
google-auth 2.40.3
graphene 3.4.3
graphql-core 3.2.6
graphql-relay 3.2.0
greenlet 3.2.4
grpcio 1.75.0
gunicorn 23.0.0
h11 0.16.0
httpcore 1.0.9
httpx 0.28.1
idna 3.10
importlib_metadata 8.7.0
importlib_resources 6.5.2
ipykernel 6.30.1
ipython 8.18.1
isoduration 20.11.0
itsdangerous 2.2.0
jedi 0.19.2
Jinja2 3.1.6
joblib 1.5.2
json5 0.12.1
jsonpointer 3.0.0
jsonschema 4.25.1
jsonschema-specifications 2025.9.1
jupyter_client 8.6.3
jupyter_core 5.8.1
jupyter-events 0.12.0
jupyter-lsp 2.2.6
jupyter_server 2.17.0
jupyter_server_terminals 0.5.3
jupyterlab 4.4.7
jupyterlab_pygments 0.3.0
jupyterlab_server 2.27.3
kiwisolver 1.4.7
lark 1.3.0
Mako 1.3.10
Markdown 3.9
MarkupSafe 3.0.2
matplotlib 3.9.4
matplotlib-inline 0.1.7
mistune 3.1.4
mlflow 2.17.2
mlflow-skinny 2.17.2
multidict 6.6.4
nbclient 0.10.2
nbconvert 7.16.6
nbformat 5.10.4
nest-asyncio 1.6.0
notebook 7.4.5
notebook_shim 0.2.4
numpy 1.24.2
opentelemetry-api 1.37.0
opentelemetry-sdk 1.37.0
opentelemetry-semantic-conventions 0.58b0
overrides 7.7.0
packaging 24.2
pandas 1.5.3
pandocfilters 1.5.1
parso 0.8.5
pexpect 4.9.0
pillow 11.3.0
pip 25.2
platformdirs 4.4.0
prettytable 3.16.0
prometheus_client 0.23.1
prompt_toolkit 3.0.52
propcache 0.3.2
protobuf 5.29.5
psutil 7.1.0
psycopg2-binary 2.9.5
ptyprocess 0.7.0
pure_eval 0.2.3
pyarrow 11.0.0
pyasn1 0.6.1
pyasn1_modules 0.4.2
pycparser 2.23
pycryptodome 3.23.0
Pygments 2.19.2
PyMySQL 1.0.2
pyparsing 3.2.5
python-dateutil 2.9.0.post0
python-json-logger 3.3.0
pytz 2025.2
PyYAML 6.0.2
pyzmq 27.1.0
referencing 0.36.2
requests 2.32.5
rfc3339-validator 0.1.4
rfc3986-validator 0.1.1
rfc3987-syntax 1.1.0
rpds-py 0.27.1
rsa 4.9.1
scikit-learn 1.6.1
scipy 1.13.1
Send2Trash 1.8.3
setuptools 80.9.0
six 1.17.0
smmap 5.0.2
sniffio 1.3.1
soupsieve 2.8
SQLAlchemy 2.0.3
sqlparse 0.5.3
stack-data 0.6.3
tabulate 0.9.0
tencentcloud-dlc-udf 1.0.0
tencentcloud-dlc-udf-runtime 1.0.6
tencentcloud-dlc-utils 1.0.5
tencentcloud-sdk-python-common 3.0.1464
tencentcloud-sdk-python-ssm 3.0.1459
terminado 0.18.1
threadpoolctl 3.6.0
tinycss2 1.4.0
tomli 2.2.1
tornado 6.5.2
tqdm 4.67.1
traitlets 5.14.3
types-python-dateutil 2.9.0.20250822
typing_extensions 4.15.0
uri-template 1.3.0
urllib3 1.26.20
wcwidth 0.2.14
webcolors 24.11.1
webencodings 0.5.1
websocket-client 1.8.0
Werkzeug 3.1.3
xmltodict 1.0.2
yarl 1.20.1
zipp 3.23.0
zope.interface 8.0

ヘルプとサポート

この記事はお役に立ちましたか?

フィードバック