Day #2 of Data Science Training at School of Computing – Telkom University 🙂
Today we learn how to crawl data from Instagram, processing it, make analysis and visualisation
The data
The results
this is the result of very latest topics 😉
Thank you very much to School of Computing – Telkom University giving ProCodeCG an honour to share a bit what we know about Data Science 🙂
Today is the first day of Data Science Training at School of Computing – Telkom University 🙂
The training room
What we learned today is how to use Python for Data Science 🙂
we learned to process different kinds of data, from txt, csv, json to xml. Tomorrow we will learn how to process data in graphql format 😉
The codes
The data
Some of the results 
The class
Tomorrow will do data crawling, parsing, analysing and visualising 😉
Today ProCodeCG is very proud to give training for LAPAN (Lembaga Penerbangan dan Antariksa Nasional/The National Institute of Aeronautics and Space).
Bapak Adi Witono, MSi, Division Head of Program and Facility Division – Space Science Center LAPAN (Kepala Bidang Program & Fasilitas Pusat Sains Antariksa LAPAN) and Dr. Emanuel Sungging Mumpuni, Division Head of Dissemination – Space Science Center LAPAN (Kepala Bidang Diseminasi, Pusat Sains Antariksa LAPAN) give opening speech before the training started
The participants have different education backgrounds and come from different divisions with different job descriptions
Some of we learned today 🙂 We learned BackEnd Programming with PHP
MySQL
creating login app with PHP to access database
displaying data from database
and then we learned to use Python for Data Science 🙂 We begin with data visualization 🙂
we used example data
and then started to use specific data used in the office (each participant should use own specific data)
we tested data in .txt, .csv and also .json
This is Observation Room in LAPAN, displaying real data from space 🙂 We will give report about this next time when we have opportunity to visit this room and see things closer 🙂
Thanks LAPAN for inviting ProCodeCG 🙂 Hoping to be able to visit LAPAN again very soon 🙂
*Photos and videos are also available here
It is fasting month but it doesn’t stop kids from coming to the class to learn and do research 🙂
Fadhlan had made some progress with his robotic project of course
The creativity is increasing exponentially 😀 😀 😀
But too bad due to too much components to be attached to the chassis, it was broken, again 😀
The battlefield 😀
While Capt. Awa has made a new breakthrough today 🙂
The robot is now can wandering around 🙂 Not yet with sensors, but the motors and wheels and chassis are working nicely together 🙂
And then Awa tried to use an remote transmitter to be able to control the movement of the robot using a remote 🙂
Awa also taught us how to learn physics including electronics using this tool 🙂
Ozan research is about IoT and he is given a task to help Robotics Team to connect the robot to cloud so it can be controlled remotely
starting with controlling a micro servo via cloud using ESPectro
Capt. Awa helped us to debug the code
The code
and the output, it finally worked after we did several debugging, and after trying everything, we change the output pin and it worked 😉
Next, Ozan has to modified the code to control two microservos 😉
Captains on duty 😉
This one working while studying for the exam next week 😀
Capt. Faris was given a task to solve problems we found in our instagram crawling machine 😉
then we finally can send our crawling result to be displayed as a wordcloud 😉
very nice isn’t it 😉
This is the quality needed to be a captain: reliability, consistency and responsibility 🙂 Capt. Awa always be the last to leave and make sure he put everything back to the storage 🙂
and he didn’t want to be captured in a pic LOL
Can’t wait to see these kids again next week 😉
The last day of ProCodeCG – BDV – Technical Series – Data Science 😉 There were 8 people left 😀
Today we learned to create histogram of the data being crawled in real time 🙂
and then get and analyze the timestamps of the posts
and then crawled some more to see the correlations. We’re still figuring out how to get username from an ID
we also tried keyvalues to store a pair of data
so later we can do the crawling independently and store the data on the same database to be processed and analyzed
Ok this is us! 😉
Thanks for joining the class!
Thanks Telkom BDV for providing everything! See you again on the next Technical Series 😉
There are only 10 people left in the class today 😀 Probably because the topic has steep learning curve 😀
We learned to crawl Instagram and do some text processing and analysis today
It required intense coding and lots of tricks
While outside there was a ProCodeCG Kids having fun while the mom learning hard in the class 😀 😀 😀
the code and the result of keyword “thanos” LOL
word occurrence frequency sorted from the highest 😉
On Monday we will get deeper into the graphql structure and dig more! 😉
ProCodeCG Data Science – Techical Series – Day #2 😉
Less people coming, probably because the topic is harder than previous topics 😀
Today we learned to process and analyze data from a weather station server 🙂
This series will be extended 🙂 There will be 3rd and 4th on 30 April and 7 May 2018 🙂
Our technical series topic for this month is Data Science 🙂
We learned about data science theories
Some basic statistics
We also crawl some data from Instagram for a certain hashtag and see how a GraphQL looks like compared to JSON. We will learn to process the data and probably will do clustering too in the next classes 😉
The class
Not as much people as before which is kind of a blessing because today we have to change venue due to Coding Mum for the Disables , another ProCodeCG event working in parallel 😀
We’re going to do about 2 – 4 more sessions of this topic, only those who attend all four classes will get certificate 🙂
Code - and rule the world 