Hi,
I tried using the deepstream analytical docker and the deepstream-app-4.
I am not able to get the output from the deepstream-app-4 into the analytical server.
I am publishing it into local ip address from deepstream_app_4 as metromind_raw and I have updated the start.sh in analatical server with IP and Google API key(map serv.)
I am only getting something like:
19/01/11 07:46:18 INFO streaming.StreamExecution: Streaming query made progress: {
"id" : "b20155a1-ba18-48e1-962c-e555f9092361",
"runId" : "d330ab4b-adf9-4719-be93-ef52f9371dc2",
"name" : "trafficFlowRate",
"timestamp" : "2019-01-11T07:46:18.150Z",
"numInputRows" : 0,
"inputRowsPerSecond" : 0.0,
"processedRowsPerSecond" : 0.0,
"durationMs" : {
"getOffset" : 1,
"triggerExecution" : 1
},
"eventTime" : {
"watermark" : "1970-01-01T00:00:00.000Z"
},
"stateOperators" : [ {
"numRowsTotal" : 0,
"numRowsUpdated" : 0
} ],
"sources" : [ {
"description" : "KafkaSource[Subscribe[metromind-start]]",
"startOffset" : {
"metromind-start" : {
"2" : 0,
"5" : 0,
"4" : 0,
"7" : 0,
"1" : 0,
"3" : 0,
"6" : 0,
"0" : 0
}
},
"endOffset" : {
"metromind-start" : {
"2" : 0,
"5" : 0,
"4" : 0,
"7" : 0,
"1" : 0,
"3" : 0,
"6" : 0,
"0" : 0
}
},
"numInputRows" : 0,
"inputRowsPerSecond" : 0.0,
"processedRowsPerSecond" : 0.0
} ],
"sink" : {
"description" : "org.apache.spark.sql.execution.streaming.ForeachSink@720e630c"
}
}
Amycao
January 17, 2019, 10:04am
2
Hi, abramjos
You need to modify deepstream-app-4 source, macro CONNECTION_STRING, to yours accordingly, then try again.
Hi, abramjos
You need to modify deepstream-app-4 source, macro CONNECTION_STRING, to yours accordingly, then try again.
Hi Amycao, I have done that.
edited deepstream_test4_app.c as:
define PROTOCOL_ADAPTOR_LIB “/usr/local/deepstream/libnvds_kafka_proto.so”
define CONNECTION_STRING “127.0.0.1;9092;metromind_raw”
I am using the localhost and in deepstream analytics server, I have updated API key and inet address as well.
Amycao
January 17, 2019, 12:29pm
4
Hi
Can you change metromind_raw to metromind-raw in the macro CONNECTION_STRING and try again?
Hmm i see, it’s a typo error?
Between i was using ds_meta as connection string and i was not able to extract data, was getting the same output and that’s why i reverted back to metromind-raw.
Will check it and let you know.
Hi amycao,
NO luck,
I have pulled down the new git repo for 360 and the deepstream3 from your website to sync eveything.
I am getting same results and the typo was not there actually.
Any idea why this is happening?
Amycao
January 25, 2019, 7:25am
7
W
Hi, abramjos
You need to modify deepstream-app-4 source, macro CONNECTION_STRING, to yours accordingly, then try again.
Hi Amycao, I have done that.
edited deepstream_test4_app.c as:
define PROTOCOL_ADAPTOR_LIB “/usr/local/deepstream/libnvds_kafka_proto.so”
define CONNECTION_STRING “127.0.0.1;9092;metromind_raw”
I am using the localhost and in deepstream analytics server, I have updated API key and inet address as well.
what i mean is change metromind_raw to metromind-raw, please noted not underline, between the words.
Yeah I have changed them accordingly
Amycao
February 19, 2019, 11:15am
9
Hi,
Have you resolved this issue, can you try with docker ip again?
export IP_ADDRESS=“docker ip” on analytic side, anything needed for analytic running, and modify test4 macro accordingly then try again.
hereby one reference
docker0 Link encap:Ethernet HWaddr 02:42:06:f4:98:89
inet addr:172.18.0.1 Bcast:172.18.255.255 Mask:255.255.0.0
inet6 addr: fe80::42:6ff:fef4:9889/64 Scope:Link
UP BROADCAST MULTICAST MTU:1500 Metric:1
RX packets:92504 errors:0 dropped:0 overruns:0 frame:0
TX packets:105923 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:95123759 (95.1 MB) TX bytes:8054116 (8.0 MB)