Quantcast
Channel: Kafka Timeline
Viewing all articles
Browse latest Browse all 1519

Events stored in Apache Web Logs - how best to get these into Kafka?

$
0
0
I have a lot of user event data being sent to an apache web server and
written to web logs. Unfortunately I don't control this flow, but do I have
access to the server the logs are being written to.

I need a way to access these events as soon as they have been written to
the log file and send this over to Kafka.

I'm aware I can write a Kafka Producer, but I was hoping there might be
something out of the box I could use that could monitor a log file and send
the contents to Kafka.

I saw from KAFKA-130 <https://issues.apache.org/jira/browse/KAFKA-130> that
in version 0.7 onwards there is something that can monitor STDIN, not sure
if I could use this for web log files?

Thanks,
James

Viewing all articles
Browse latest Browse all 1519

Latest Images

Trending Articles



Latest Images