This job listing has expired and the position may no longer be open for hire.

Data Engineer - Pyspark at Cognizant

Posted in Information Technology 30+ days ago.

Type: Full-Time
Location: Chicago, Illinois

Job Description:

Data Engineer - Pyspark

*Please note, this role is not able to offer visa transfer or sponsorship now or in the future*

​​​*This position can be 100% remote

About AI & Analytics: Artificial intelligence (AI) and the data it collects and analyzes will soon sit at the core of all intelligent, human-centric businesses. By decoding customer needs, preferences, and behaviors, our clients can understand exactly what services, products, and experiences their consumers need. Within AI & Analytics, we work to design the future—a future in which trial-and-error business decisions have been replaced by informed choices and data-supported strategies.

By applying AI and data science, we help leading companies to prototype, refine, validate, and scale their AI and analytics products and delivery models. Cognizant’s AIA practice takes insights that are buried in data, and provides businesses a clear way to transform how they source, interpret and consume their information. Our clients need flexible data structures and a streamlined data architecture that quickly turns data resources in

  • Planning, building, and running enterprise class information management solutions across a variety of technologies (Big Data, data profiling, ETL batch processing, streaming etc)

  • Curating content to support the key business initiatives

  • Working with data scientist and data analysts across functional disciplines.

  • Demonstrate high proficiency across a wide range of technologies and platforms related to software design and development, programming languages, data integration, data warehousing, data analysis and cloud environments.

  • Highly autonomous and productive in performing activities, requiring only minimal direction from or interaction with supervisor. Keeps key partners informed through effective verbal and written communication.

  • May mentor/supervise a team of one or more and guide and evaluate the performance of those individuals is accountable for the effective performance of the team/individuals.

  • Ensuring appropriate security and compliance policies are followed for information access and dissemination

  • Defining and applying information quality and consistency business rules throughout the data processing lifecycle

  • Collaborating with information providers to ensure quality data updates are processed in a timely fashion

Onsite BigData Architect:

  • Candidate with 5+ years of Big data experience anda solid understandingg of below specified functional areas.

  • Previously might have played any of the following data Engineering roles such as Big-data Architect, ETL Architect, data analyst, and/or solution Architect of Enterprise applications.

  • Experience with Cloudera CDH/ CDP and ecosystem tools (Core Java, SQL, scala, pySpark, Impala, Hive, Hue, Hadoop, SparkSQL etc.), Oracle, Teradata, python, Shell-Script, Dev Ops and Amazon Web Services (S3 etc.) preferred.

Cognizant (NASDAQ: CTSH) is a leading provider of information technology, consulting, and business process outsourcing services, dedicated to helping the world's leading companies build stronger businesses. Headquartered in Teaneck, New Jersey (U.S.). Cognizant is a member of the NASDAQ-100, the S&P 500, the Forbes Global 1000, and the Fortune 500 and we are among the top performing and fastest growing companies in the world.

Our strength is built on our ability to work together. Our diverse backgrounds offer different perspectives and new ways of thinking. It encourages lively discussions, inspires thought leadership, and helps us build better solutions for our clients. We want someone who thrives in this setting and is inspired to craft significant solutions through true teamwork.





Technical Skills

SNo Primary Skill Proficiency Level * Rqrd./Dsrd.
1 PySpark PL1 Required
2 Map Reduce PL4 Required
3 Hive PL4 Desired
4 Apache Hadoop PL3 Required
5 ANSI SQL PL4 Desired
6 Core Java PL1 Required


Domain Skills

SNo Primary Skill Proficiency Level * Rqrd./Dsrd.
1 SIT - System Intergration Test NA Desired
2 UAT - User acceptance test NA Desired
3 Data Investigation NA Desired
4 Data Governance NA Desired


* Proficiency Legends

Proficiency Level Generic Reference
PL1 The associate has basic awareness and comprehension of the skill and is in the process of acquiring this skill through various channels.
PL2 The associate possesses working knowledge of the skill, and can actively and independently apply this skill in engagements and projects.
PL3 The associate has comprehensive, in-depth and specialized knowledge of the skill. She / he has extensively demonstrated successful application of the skill in engagements or projects.
PL4 The associate can function as a subject matter expert for this skill. The associate is capable of analyzing, evaluating and synthesizing solutions using the skill.

More jobs in Chicago, Illinois

Insurance Services Office, Inc.


Press Ganey Associates, LLC
More jobs in Information Technology


Air Express International USA, Inc.