Job Description
Remote Lead Data Engineer needs 7+ years' experience as data engineer in consumer finance or equivalent industry (consumer loans, collections, servicing, optional product, and insurance sales)
Remote Lead Data Engineer requires:
Strong background in math, statistics, computer science, data science or related discipline
- Advanced knowledge one of language: Java, Scala, Python, C#
- Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
- Proficient with:
- Data mining/programming tools (e.g. SAS, SQL, R, Python)
- Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
- Data visualization (e.g. Tableau, Looker, MicroStrategy)
- Comfortable learning about and deploying new technologies and tools.
- Organizational skills and the ability to handle multiple projects and priorities simultaneously and meet established deadlines.
- Good written and oral communication skills and ability to present results to non-technical audiences
- Knowledge of business intelligence and analytical tools, technologies and techniques.
- Familiarity and experience in the following is a plus:
- AWS certification
- Spark Streaming
- Kafka Streaming / Kafka Connect
- ELK Stack
- Cassandra / MongoDB
- CI/CD: Jenkins, GitLab, Jira, Confluence other related tools
Mandatory Skills Advanced knowledge one of language: Java, Scala, Python, C#? Production experience with: HDFS, YARN, Hive, Spark, Kafka, Oozie / Airflow, Amazon Web Services (AWS), Docker / Kubernetes, Snowflake
Proficient with Data mining/programming tools (e.g.?SAS, SQL, R, Python) Database technologies (e.g. PostgreSQL, Redshift, Snowflake. and Greenplum)
Remote Lead Data Engineer duties:
- Create and manage cloud resources in AWS
- Data ingestion from different data sources which exposes data using different technologies, such as: RDBMS, REST API, flat files, Streams, and Time series data based on various proprietary systems. Implement data ingestion and processing with the help of Big Data technologies
- Data processing/transformation using various technologies such as Spark and Cloud Services.
- Develop automated data quality check to make sure right data enters the platform and verifying the results of the calculations
Employment Type: Full-Time
Salary: $ 110.00 Per Hour
Job Tags
Hourly pay, Full time, Remote job,
Similar Jobs
Community Legal Services, Inc.
CLS is seeking 2 paralegals for its Housing Unit. This full-time position is responsible for... ...and administrative records, including data entry into client databases and other... ...minimum starting salary is $47,390 for entry-level applicants, which increases with relevant...
Amtrak
...company of the future. SUMMARY OF DUTIES: Performs general police duties, processes, and operations for the protection of life... ...plans; wellness programs; flexible spending accounts; 401(k) retirement plan; life insurance; paid time off; reimbursement of education...
CIS Group of Companies
...Income or Just Be Productive? Become an Independent Residential Insurance Inspector with CIS Group! Are you looking for a flexible,... ...position offers flexibility and autonomy. What You'll Do: Travel to residential homes to complete exterior (interior photos here...
Physical Therapy Central
Overview: An Amazing Opportunity for a Physical Therapist! Sign-On Bonus! Monthly Production Bonus! Fully Funded CE Opportunities! Great Career Ladder! Physical Therapy Central , is a member of the Confluent Health family of physical and occupational therapy companies...
Emerson
If you are a **Field Engineer** looking for growth and professional development, we have a great opportunity for you! Based out of our **Tinley Park, IL** office we provide expert support for PLCs and/or DCS systems. You will be on a team of customer support engineers...