Software Engineer-Big Data Hadoop, Hybrid, Charlotte, NC Job at Strategic Staffing Solutions, Charlotte, NC

S25mS3drQm1iOVpwblorSVpQZ0pXQnpONnc9PQ==
  • Strategic Staffing Solutions
  • Charlotte, NC

Job Description

STRATEGIC STAFFING SOLUTIONS (S3) HAS AN OPENING!

Strategic Staffing Solutions is currently looking for a Big Data Hadoop Engineer, a W2 contract opportunity with one of our largest clients!

Candidates should be willing to work on our W2 ONLY.

Software Engineer-ETL/Big Data Hadoop Engineer

Location- Charlotte, NC

Duration- 12 Months

Schedule: Hybrid

W2 only, no c2c

Pay: upto to $80

Job Descriptions:

Big Data Hadoop Engineer: -This is a need for someone to build and write the capabilities.- Experience building and enhance scala framework and spark experience-Java-Python. The Risk Data Services team is seeking a Lead Software Engineer.

Driving strategy for the team for entire platform and help with migration to cloud.Big Data Hub, the tools are used purely for ETL functions, moving and conforming data, not for building web applications.

The use of Python and Java is for Data Engineering, we are not seeking Web Developers, back and front end etc.

Job Expectations:

  • Design and implement automated spark-based framework to facilitate data ingestion, transformation and consumption.
  • Implement security protocols such as Kerberos Authentication, Encryption of data at rest, data authorization mechanism such as role-based access control using Apache ranger.
  • Design and develop automated testing framework to perform data validation. Enhance existing spark-based frameworks to overcome tool limitations, and/or to add more features based on consumer expectations. 
  • Design and build high performing and scalable data pipeline platform using Hadoop, Apache Spark, MongoDB, Kafka and object storage architecture.
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure
  • Collaborate with application partners, Architects, Data Analysts and Modelers to build scalable and performant data solutions.
  • Effectively work in a hybrid environment where legacy ETL and Data Warehouse applications and new big-data applications co-exist
  • Work with Infrastructure Engineers and System Administrators as appropriate in designing the big-data infrastructure.
  • Support ongoing data management efforts for Development, QA and Production environments Provide tool support, help consumers

Required Qualifications:

  • 5+ years of experience of software engineering
  • 5+ years of experience delivering complex enterprise wide information technology solutions
  • 5+ years of experience delivering ETL, data warehouse and data analytics capabilities on big-data architecture such as Hadoop
  • 5+ years of Apache Spark design and development experience using Scala, Java, Python or Data Frames with Resilient Distributed Datasets (RDDs), Parquet or ORC file formats 6+ years of ETL (Extract, Transform, Load) Programming experience 
  • 2+ years of Kafka or equivalent experience
  • 2+ years of NoSQL DB like Couchbase/MongoDB experience.
  • 5+ experience working with complex SQLs and performance tuning

Desired Qualification

3+ years of Agile experience 

2+ years of reporting experience, analytics experience or a combination of both

2+ years of operational risk or credit risk or compliance domain experience 2+ years of experience integrating with RESTful API 

2+ years of experience with CICD tools.

Job ID: JOB-236687 Publish Date: 25 Jul 2024

Job Tags

Contract work,

Similar Jobs

Sheraton

Hotel Front Desk Job at Sheraton

 ...Reports to: Front Office Manager Job purpose To consistently and professionally perform all front desk duties in accordance with hotel and brand standards. Responsibilities Report to work on time and in proper uniform adhering at all times to company grooming... 

University of Michigan - Ann Arbor

REGISTERED NURSE: Ambulatory Care Services (Ambulatory Care Nurse Resource Pool-Surgical Clinics) | University of Michigan - Ann Arbor Job at University of Michigan - Ann Arbor

 ...Provide nursing care in a variety of Ambulatory Care settings with primary responsibilities in the Surgical Clinics. This position includes care of adult and pediatric patients and includes but not limited to: Assessment of patient needs and assist with medical... 

Everstory Partners

Cemetery Groundskeeper Job at Everstory Partners

 ...comfort and guidance, and a partner in celebrating the life and legacy of the person who has passed. The Impact You Will Make The Cemetery Groundskeeper at Everstory is a dedicated, reliable and hard-working individual who understands the importance of detail and... 

Hilton

Bellperson (Seasonal) - Hotel del Coronado, A Curio Collection by Hilton Job at Hilton

The iconic _Hotel del Coronado_ is looking for a **Bellperson to join the team** \! Joinone of the last surviving wooden Victorian beach...  ...**What are we looking for?**Since being founded in 1919, Hilton has been a leader in the hospitality industry\. Today, Hilton remains... 

Anytime Fitness

Personal Training Manager Job at Anytime Fitness

 ...Full-time Personal Training Manager at Anytime Fitness Mayfair-Park Hill. Are you committed to changing another human being's life for the better, every single day? We are a coaching club dedicated to helping every member achieve a healthier and more fit life through...