Lead Data Engineer(Bigquery)

Full Time
Remote
$84,506 - $190,681 a year
Posted
Job description

Scope of Services: Replicate functioning code from one environment to another (on premise Mainframe/Bluebird to Google Cloud); Majority of the coding required will be in BigQuery/SQL, YAML, Python and Spark. Effort will involve using the data wrangling skills to understand patterns and data discovery to drive algorithmic development and enhancements.

  • Create projects in GCP. Store coding scripts, log files, output files in GCP where they may be referenced (not necessarily run)
  • Certify Data Management capabilities in the new system compared to legacy with same or improved results.
  • Review legacy processes and code created on-premise, compare to new Google
  • Cloud Platform (GCP) version, ensure it is stable, verify results, and recommend best practices
  • Create new processes for new product development • Develop strategies, standards and best practices in the areas of data wrangling, data visualization and data integration

What is Needed:

  • 5-7 years of data management and analysis experience in the credit risk, telecommunications, financial services, marketing, fraud
  • 5+ years of experience with data querying/handling tools (Spark, Python,, SQL, DataLever/RedPoint DM, Spotfire, Tableau or other industry-standard tools)
  • 2+ years of experience with graph databases
  • Experience with analyzing large (multi-TB to PB), complex data sets for consumer or commercial data
  • Strong knowledge of credit bureau data
  • Experience developing and deploying Data Matching and Entity Resolution algorithms and/or have previously worked on record linkage capabilities.
  • Experience with Google cloud

Job Type: Full-time

Salary: $84,506.16 - $190,681.38 per year

Schedule:

  • Monday to Friday

Experience:

  • Informatica: 1 year (Preferred)
  • SQL: 1 year (Preferred)
  • Data warehouse: 1 year (Preferred)

Work Location: Remote

learninglandscape.com is the go-to platform for job seekers looking for the best job postings from around the web. With a focus on quality, the platform guarantees that all job postings are from reliable sources and are up-to-date. It also offers a variety of tools to help users find the perfect job for them, such as searching by location and filtering by industry. Furthermore, learninglandscape.com provides helpful resources like resume tips and career advice to give job seekers an edge in their search. With its commitment to quality and user-friendliness, learninglandscape.com is the ideal place to find your next job.

Intrested in this job?

Related Jobs

All Related Listed jobs