Cherche un Data Tech Lead – parlant anglais courant pour cette mission sur Dijon :
Your daily activities :
- Development of data ingestion and transformation jobs with PySpark, Python or Scala/JAVA with Spark
- Implementation of unit tests and integration tests
- Participate in design workshops
- Drafting and updating of technical documentations
Expectations :
- Bring in a strong expertise on the technologies involved
- Demonstrate your ability to popularize new technologies from the businesses
- Be innovative and proactive with your colleagues but also to customers
- Work with agility and think about the quality of your projects
- Develop your technical and human competencies on a daily basis by working with passionate and qualified people
Your competencies :
- You have an advanced mastery of data modeling and advanced functional programming (object-oriented and multi-task)
- Implementing distributed algorithms can easily get uo to speed
- You have a good level of communication in writing and speaking, English would be a real plus and are able to work in a team
- You like to share your expertise with teams
- You are curious and a provider of ideas
The Technical environment on which you will evolve :
- Distributed Computing Framework : Spark
- Data platform : AWS Lakhouse (Common Data Hub : CDH), Databricks
- Languages : Scala, Python
- Data streaming framework: Kafka, Kinesis
- Databases : Oracle, PostgreSQL, AWS Redshift
- Search engines : Splunk, SolR
- CI/CD : Jenkins, gilab / CI, Airflow
- Cloud : AWS