Florian Courouge

Industrialization of Big Data and Streaming platform at Credit Agricole Developing Streaming applications in Scala (MVP based on Kafka, Spark Streaming and Vertica). Developing Golang applications to rewrite Ansible roles in full YAML rather than in Ansible hybrid syntax. Co-construction of Streaming offers - Advice on DevOps practices - Advice on Streaming Architectures - Industrialization and Advice about Ansible - Application development Streaming in Scala Update ansible version from 2.3 to 2.6 Multi-project inventory Dockerization Ansible/Jenkins Industrialization of Kafka (SSL & Authentication management) Benchmark Kafka performance Technical environment: Automation: Ansible Job orchestrator: Jenkins Source code manager: Gitlab Package manager: Pulp Infrastructure: Openstack, Ceph Hadoop distribution: Mapr Ecosystem: Kafka, Spark, Mapr -FS, Hbase, Cassandra, Mongodb, Flume, Oozie, Pig, Mapr-Stream, ElasticStack, Sqoop, Vertica, Drill Monitoring: Prometheus, Grafana, ELK Alerting: Sensu Virtualization: KVM, LXC, Docker Environment: Fedora / CentOS Developement: FullStack Infrastructure Size: 7000 Vcpu, 50 TB RAM, 6PB of Disks.

Industrialization and reliability of a Reactive Architecture for a large account customer. Management of out-of-production (~ 500 VMs) and production (+100 VMs) environments. About 30 developers (Scala & Go) on the platform and more than 30 applications available in production (Scala, Go). Record of events in production (+25 million events absorbed over 24 hours). Team of 3 people in OPS (including myself), our role: Development mainly on Ansible (expert), Shell, Python, Groovy, Angular, NodeJS, Ruby, Golang, Scala. Administration & Update of components: Cassandra, Schema-Registry, Zookeeper, Kafka, Spark, ElasticSearch, Logstash, Kibana, Filebeat, Alertmanager, Prometheus & Grafana, Gitlab, Gitlab-Runner, Jenkins & Nexus, Linux, CentOS, LXC, Nginx, Play, Firewall, DNS. Cloud Providers used OVH & NUTANIX infrastructure. CI / CD based on Jenkins, Gitlab, Nexus. Working method: Agile, Scrum, Kanban. My assets: Management of major incidents in all environments (+ 50 employees on the project) Facilitator and diplomat in difficult project / policy context. Initiation of performance optimization and cost optimization projects on Stack and Ansible components. Proposal strength to optimize and / or improve coordination and processes between dev / infra / secu / network / ops / info-manager and MCO teams (+ 100 people). Implementation of a Self Healing system with Ansible / Jenkins / Alertmanager / Prometheus on non-production environments (to facilitate the maintenance of platforms). Maintain a web interface to list the various useful URLs generated in a fully dynamic way via Angular, JSON & Ansible. Maintaining Gitflow and preparing releases. Identify good practices for the client (evaluate financial and time-saving contributions).

Architecture proposal and customer support for the project My role: Comparison of Cloud solutions Comparison of Hadoop distributions Adaptive and modular architecture recommendation Design and implementation of the database Realization of the revenue phases Industrialization of the solution (Red Hat VM and integration of algorithms in Python) Technical environment: CentOS, Shell, Python, Oracle, TIBCO ESB, HTML