Ben Fradet

Data engineer


Jan 2017 to present: Data engineer, Snowplow Analytics - remote
Converting the existing Scalding jobs to Apache Spark
Technical environment: Scala, Spark, Scalding, AWS

Feb 2015 to Dec 2016: Data engineer, French ministry of Defense - Paris, France
Built the new stream processing platform based on Spark and Kafka
Developed our custom ETL with Akka
Worked with a legacy, Storm-based, stream processing platform
Wrote Pig jobs
Technical environment: Scala, Java, Spark, Kafka, Akka, Storm, Pig

Jun 2014 to Sep 2014: Software engineer, Snowplow Analytics - remote
Built a RESTful API for Iglu, a machine-readable JSON schemas repository
Technical environment: Scala, PostgreSQL, Spray, Akka, Slick, Swagger

Feb 2013 to Feb 2014: Software engineer, SAP - Galway, Ireland
Made an internal testing tool compatible with new software running on SAP Hana
Built a data warehouse and the dashboards/monitoring tools associated
Technical environment: C#, Microsoft SQL Server, SAP Hana, WPF, WCF


Aug 2016 to present: spark-kafka-writer
Writing Spark RDDs and DStreams to Kafka seamlessly

Feb 2015 to present: Open source contributions
Diverse contributions on Github to Spark and other open source projects

Apr 2014 to present:
Personal blog containing mostly machine learning related articles

Dec 2013 to present: RiotSharp
C# wrapper around the Riot Games API


Sep 2009 to Jun 2015: Diplôme d'ingénieur en informatique (Master in Computer Science)
Focused on machine learning and data science: SVM, neural networks, KMeans, etc
University of Technology of Compiègne, Compiègne, France

Aug 2011 to Feb 2012: Semester abroad studying image processing and biometrics
Högskolan Dalarna, Borlänge, Sweden

Jun 2009: French baccalauréat concentration Mathematics with (high) distinction
Lycée Blaise Pascal, Châteauroux, France


  1. Scala
  2. Apache Spark
  3. Git
  4. Java
  5. Apache Kafka
  6. R
  7. C#
  8. Akka
  9. Octave/Scilab/Matlab


Cross-training, swimming, running, handball, snowboarding
Reading technical books (on machine learning and computer science in general)
and heroic fantasy