Query: Can you guide me how to set up Flume on Edureka VM.


We have already installed Flume in the Edureka VM. To execute flume, please follow below commands:


Command:  cd /usr/lib/flume-ng/apache-flume-1.4.0-bin/bin/

Command:  ./flume-ng agent -n TwitterAgent -c conf -f /usr/lib/flume-ng/apache-flume-1.4.0-bin/conf/flume.conf 



After sometime press ctrl + c to stop the streaming data. 




Open the browser and goto below url

URL: http://localhost:50070/dfshealth.jsp


Click on Browse File System -> /user ->  you can find a /flume/tweets directory created in it which has streamed data.


You can find the data as in the below image.



Please refer to the below link for the steps to set up Flume on CDH3 VM, but we can try the same steps on CentOS alsoas well. (Just for reference)

Link : https://edureka.wistia.com/medias/hsby0ufqqo/download?media_file_id=48186073


Please feel free to revert if you need any further help.