Job title: Data Engineer
Location: UK
Duration: 6-month contract Inside IR35
Working Mode: Fully Remote
Vetting: Active SC Clearance
Job Description:
Data Engineer Skills and Technologies Data Engineering:
– Strong understanding of data concepts
– data types, data structures, schemas (both JSON and Spark), schema management etc
– Strong understanding of complex JSON manipulation – Experience working with Data Pipelines using a custom Python/PySpark frameworks
– Strong understanding of the 4 core Data categories (Reference, Master, Transactional, Freeform) and the implications of each, particularly managing/handling Reference Data.
– Strong understanding of Data Security principles
– data owners, access controls
– row and column level, GDPR etc including experience of handling sensitive datasets
– Strong problem solving and analytical skills, particularly able to demonstrate these intuitively
Requirements
Required Skills:
Languages / Frameworks
– JSON
– YAML
– Python (as a programming language, not just able to write basic scripts. Pydantic experience would be a bonus.)
– SQL
– PySpark
– Delta Lake
– Bash (both CLI usage and scripting)
– Git
– Markdown
– Scala (bonus, not compulsory)
– Azure SQL Server as a HIVE Metastore (bonus) Technologies
– Azure Databricks
– Apache Spark
– Delta Tables
– Data processing with Python
– PowerBI (Integration / Data Ingestion)
– JIRA
Job Description About the Company: Inspired by the Mediterranean, Moroccanoil comes to life through our iconic turquoise packaging and signature fragrance, for an exotic experience that transports the senses. Our original Moroccanoil Treatment pioneered oil-infused...
...develop new features to continuously optimize computational performance, and create tools to assist... ...: Pursuing a BS/MS degree in Computer Science, Software Engineering, Mathematics,... ...Come join us and apply today!At WeRide, interns collaborate with industry leaders on impactful...
...weekends, Holidays, OT Benefits: Medical, Dental, Vision and 401(k) with match. PTO Position responsibilities: The CDL Driver is responsible for unloading and delivering products to our customers as well as pre-trip and post-trip inspections of equipment...
Job Description The pay for this position is salaried, non-exempt and starts at $50,000-55,000/annually with possible overtime. This position is also eligible for participation in performance-based bonus rewards. \n What can you expect?\n \n Real work/life hours...
...Summit Medical Staffing Nursing is seeking a travel nurse RN Oncology for a travel nursing job in Norfolk, Virginia. Job Description... ...tax-free stipend amount to be determined. Posted job title: Hematology Oncology 5B RN Pediatric ONC About Summit Medical Staffing...