Datalab European Southern Observatory
Part of the code for the Datalab project developed for the European Southern Observatory (ESO).
Repository with the code I developed for the datalab project at the European Southern Observatory (ESO).
What is inside
It contains among other things many Dockers with images of the installed databases (Elasticsearch, Cassandra, Elasandra, etc). Puppet files to automatically install docker compose. Python scripts, C++ to parse, inject the data into the databases. Installation also of Kibana, Grafana, etc. and Dockers with own miscellaneous applications.
Big Data Analysis:
- Installation Datalab for Observatory Logs:
Elasticsearch,Cassandra,Elassandra,Kairosdb. - Servers orchestration:
Puppet. - Installation and work with Data Analytic tools, ELK:
Jupyter,Grafana,Kibana. - Security:
Reverse proxy,openScap,openVAS,Seccubus,Dagda. - Anomaly detection:
Python(Pandas,TensorFlow). - Script:
Python,Bash. - Data Visualization:
Python(Matplotlib,Bokeh,Plotly).