./bin/kafka-server-start.sh config/server.properties
./bin/kafka-topics.sh --create --zookeeper {kafka_zk_ip}:2181 --replication-factor 1 --partitions 1 --topic mytopicOutput:Created topic "mytopic".
{kafka_zk_ip}:2181 is the ZooKeeper address of the Kafka cluster.{"type": "kafka","dataSchema": {"dataSource": "mytopic-kafka","parser": {"type": "string","parseSpec": {"timestampSpec": {"column": "time","format": "auto"},"dimensionsSpec": {"dimensions": ["url", "user"]},"format": "json"}},"granularitySpec": {"type": "uniform","segmentGranularity": "hour","queryGranularity": "none"},"metricsSpec": [{"type": "count","name": "views"},{"name": "latencyMs","type": "doubleSum","fieldName": "latencyMs"}]},"ioConfig": {"topic": "mytopic","consumerProperties": {"bootstrap.servers": "{kafka_ip}:9092","group.id": "kafka-indexing-service"},"taskCount": 1,"replicas": 1,"taskDuration": "PT1H"},"tuningConfig": {"type": "kafka","maxRowsInMemory": "100000"}}
{kafka_ip}:9092 is the IP and port of the bootstrap.servers in your Kafka cluster.curl -XPOST -H 'Content-Type: application/json' -d @kafka-mytopic.json http://{druid_master_ip}:8090/druid/indexer/v1/supervisorOutput:{"id":"mytopic-kafka"}
{druid_master_ip}:8090 is the node where the overload process is deployed, which is generally a master node../bin/kafka-console-producer.sh --broker-list {kafka_ip}:9092 --topic mytopic
{kafka_ip}:9092 is the IP and port of the bootstrap.servers in your Kafka cluster.query-mytopic.json in the Druid cluster.{"queryType" : "search","dataSource" : "mytopic-kafka","intervals" : ["2020-03-13T00:00:00.000/2020-03-20T00:00:00.000"],"granularity" : "all","searchDimensions": ["url","user"],"query": {"type": "insensitive_contains","value": "roni"}}
{"time": "2020-03-19T09:57:58Z", "url": "/foo/bar", "user": "brozo", "latencyMs": 62}{"time": "2020-03-19T16:57:59Z", "url": "/", "user": "roni", "latencyMs": 15}{"time": "2020-03-19T17:50:00Z", "url": "/foo/bar", "user": "roni", "latencyMs": 25}
python -c 'import datetime; print(datetime.datetime.utcnow().strftime("%Y-%m-%dT%H:%M:%SZ"))'
curl -XPOST -H 'Content-Type: application/json' -d @query-mytopic.json http://{druid_ip}:8082/druid/v2/?pretty
{druid_ip}:8082 is the broker node of your Druid cluster, which generally resides on a master or router node.
Query result:[ {"timestamp" : "2020-03-19T16:00:00.000Z","result" : [ {"dimension" : "user","value" : "roni","count" : 2} ]} ]
Apakah halaman ini membantu?
Anda juga dapat Menghubungi Penjualan atau Mengirimkan Tiket untuk meminta bantuan.
masukan