We use cookies to improve the user experience, analyze traffic and display relevant ads.
Details Accept
Enter position

Big Data Engineer Salary in Hyderabad - PayScale

Receive statistics information by mail
Unfortunately, there are no statistics for this request. Try changing your position or region.

Найдите подходящую статистику

Analog Design Engineer

Смотреть статистику

ASIC Verification Engineer

Смотреть статистику

Citrix Engineer

Смотреть статистику

Data Engineer

Смотреть статистику

Electrical Site Engineer

Смотреть статистику

ICT Engineer

Смотреть статистику

Ios Engineer

Смотреть статистику

It Support Engineer

Смотреть статистику

IT Test Data Engineer

Смотреть статистику

L2 Engineer

Смотреть статистику

L2 Support Engineer

Смотреть статистику

Linux Engineer

Смотреть статистику

Mechanical Site Engineer

Смотреть статистику

Middleware Engineer

Смотреть статистику

Network Operations Engineer

Смотреть статистику

Noc Engineer

Смотреть статистику

Plc Engineer

Смотреть статистику

Rtl Design Engineer

Смотреть статистику

Senior Database Engineer

Смотреть статистику

Senior Network Engineer

Смотреть статистику

Senior Service Engineer

Смотреть статистику

Senior Verification Engineer

Смотреть статистику

Signal Integrity Engineer

Смотреть статистику

Software Configuration Engineer

Смотреть статистику

Technical Solutions Engineer

Смотреть статистику

Technical Support Analyst

Смотреть статистику

Test Data Engineer

Смотреть статистику

Utility Engineer

Смотреть статистику

Verification Engineer

Смотреть статистику

Web Engineer

Смотреть статистику
Show more

Recommended vacancies

Sr. Data Engineer - Analytics & Reporting
JPMorgan Chase, Hyderabad, Any
Organization DescriptionThe Chief Data Office (CDO) in Corporate and Investment Banking (CIB) is a business-focused entity aiming to deliver high-quality, compliant data to unlock value for stakeholders. The CDO manages the overall strategy and execution of the CIB's data agenda. The Reference Data Product (RDP) organization, a part of the CIB CDO, provides reference data products to support business needs. The Reference Data Analytics (RDA) Team, under the CIB CDO, is tasked with the creation and maintenance of the Reference Data Analytics platform.Job Description The Reference Data Analytics (RDA) Team is responsible for defining, designing, building & maintaining the Reference Data Analytics platform - as part of CIB CDO Reference Data Product offering.As part of Reference Data Analytics team, you will be required to collaborate and define, design, build & maintain various Reporting & BI solutions that will help CIB Operations, CIB Chief Data Office and other CIB Lob functions with intuitive insight into CIB reference data, to enable faster business decision, data adoptions, remediation's and drive strategic initiates across CIB domain.Job Summary : As a Senior Data Engineer - Analytics & Reporting within the Reference Data Analytics team, you will be tasked with collaborating to define, design, build, and maintain various Reporting & Business Intelligence solutions. These solutions will assist the Corporate and Investment Banking (CIB) Operations, CIB Chief Data Office, and other CIB Line of Business functions by providing intuitive insight into CIB reference data. This will enable quicker business decisions, data adoptions, remediations, and promote strategic initiatives across the Corporate and Investment Banking domain. Job Responsibilities: Manage & mentor a team of data visualization experts Bring innovations through ideas & tools to build new analytic capabilities on the platform Engage with stakeholders to understand & elaborate BI requirements Analyzing of Source Data, define ingestion mechanism and data model, best suited for BI delivery Manage Jira backlog, dependency and end to end delivery responsibility including testing & entitlement, required to meet business demand Be a key participant in defining Product Strategy, Tool Selection, Resolving Technical Blockers, Agile ceremonies. Be an individual contributor as well lead a team of BI experts Required qualifications, capabilities and skills: Requirement Grooming, documentation skill using tools like Jira or similar - 7+yrs Data Analysis skill, using tools & technologies like SQL, PLSQL, Alteryx, Python - 5+ yrs Data Modeling Skill, using tools like Erwin or similar - 3+ yrs Data Reporting Skill, using Business Objects, or similar - 5+ yrs Data Visualization Skill, using Tableau, Qlik Sense, or similar - 5+ yrs Knowledge of database storage, collection & aggregation models, techniques & technologies Preferred qualifications, capabilities and skills : Experience with cloud platforms like GOS or AWS is a PLUS.About usJPMorgan Chase & Co., one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.About the TeamThe Corporate & Investment Bank is a global leader across investment banking, wholesale payments, markets and securities services. The world's most important corporations, governments and institutions entrust us with their business in more than 100 countries. We provide strategic advice, raise capital, manage risk and extend liquidity in markets around the world.Salary: . Date posted: 03/20/2024 10:26 PM
Sr. Data Engineer
Federal Express, Inc., Hyderabad, Any
General Summary\nCandidate will be responsible for creating cutting-edge technologies to improve the customer and\noperational experience. Candidate will have the opportunity to lead the paradigm shift for developing intelligent data platforms on cutting-edge technology including Big Data, Streaming. The candidate will provide the leadership and direction for development of enterprise solutions.Position ResponsibilitiesResearch and develop Data Ingestion pipelines.Drive adoption of cloud-based data ingestion systems into next-generation of FedEx SolutionsCreate data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.Build prototypes of learning solutions to show proof-of-concepts and develop scalable integrated enterprise services.Design, develop, implement, test intelligent application solutions and in a PaaS environment.Strong communication skills both written and verbal. Contribute to a positive culture of continuous improvement and operational excellence by identifying and implementing process improvements where appropriate.Skills & Experience Minimum Qualifications: Bachelor's Degree or equivalent in Computer Science, Engineering, Information Systems, and overall 8 +Years of IT experience or related field and 6 years of relevant experience. Skills/Knowledge Considered a PlusIn-depth knowledge of database structures/ data warehousing principles, and experience in SQL across different platforms including structured and unstructured data from various enterprise sources.Work with internal and external subject matter experts to select relevant source of information and explore abundance of data available in FedEx to identify and solve business problems.Ability to manipulate and analyze data with a scientific approach in order to determine the best and most optimal solution.Collaborates with cross-functional teams to understand the business problem, gather business requirements, supporting data and with/without guidance of leadership, help stakeholders/partners understand the business and scientific principles behind the process to gain their buy-in.Proficiency with data integration tools such as Ab Initio, Azure Data Factory and cloud infrastructure like Azure or Oracle Cloud.Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores and experience with building and optimizing 'big data' data pipelines, architectures, and data sets.Build processes supporting data transformation, data structures, metadata, dependency, and workload management. Initiative and passion for finding solutions to ambiguous problems and ability to work in difficult situations and across organizational boundaries.Strong communication skills both written and verbal, with ability to communicate or convey the results to audience at all levels.Additional InformationPosting Date: 2024-03-25FedEx Logistics provides freight forwarding, as well as import and export services that allow companies to reach markets throughout the world. They help customers of all sizes solve the intricacies of shipping goods globally by providing comprehensive international ocean and air freight forwarding, surface transportation and distribution, customs brokerage, trade and customs advisory services, and advanced e-commerce and trade facilitation solutions. We're glad you stopped by and hope your job search experience with FedEx Logistics, Inc. will be rewarding. We look forward to hearing from you!Salary: . Date posted: 03/25/2024 08:39 PM
Sr. Data Engineer
Discovery, Inc. (Formerly Scripps Networks Interactive), Hyderabad, Any
Every great story has a new beginning, and yours starts here. Welcome to Warner Bros. Discovery... the stuff dreams are made of. Who We Are... When we say, "the stuff dreams are made of," we're not just referring to the world of wizards, dragons and superheroes, or even to the wonders of Planet Earth. Behind WBD's vast portfolio of iconic content and beloved brands, are the storytellers bringing our characters to life, the creators bringing them to your living rooms and the dreamers creating what's next...From brilliant creatives, to technology trailblazers, across the globe, WBD offers career defining opportunities, thoughtfully curated benefits, and the tools to explore and grow into your best selves. Here you are supported, here you are celebrated, here you can thrive. Your New Role :This role will work with a fast-paced team to create the data technology stack that can be used to deliver end-user insights used for developing the next generation of digital products and product strategies. You'll also help build out an internal data pipeline and develop ways to optimize data technologies to shape our digital data strategy. Your Role Accountabilities: Gain an understanding of brand and enterprise data warehouse/reporting requirements that will inform the data architecture and modeling approach. Employ these learnings to construct appropriate ETL/ELT processes, database queries, and data/permission models that support data aggregation and reporting on actionable insights. Passion to write code, which is efficient, organized, simple, scalable & reusable meeting business requirements. Enthusiasm to learn and find opportunities to enhance and adapt in daily engineering activities is highly desired. Deliver end-to-end JIRA User stories meeting quality expectations of the team. Collaborate closely with internal and matrixed departments, including Operations, Technology, PMO, Product Teams and Data Strategy/Insights to design, build, test, and deploy data warehouse solutions and reporting tools. Gain an understanding of multiple datasets to be able to perform ad-hoc analysis for different business units. Prepare effort estimation including researching and estimating costs of software development, unit testing. May provide estimates for upgrades of vendor packages upgrades and integration with existing systems. Participate in QA testing for data pipeline projects as well as implementation changes to the suite of analytical tools. Write reproducible data analysis over Peta bytes of data using innovative technologies. Mentor junior team members. Flexibility to work in second shift. Qualifications & Experiences: 9-12 years of experience in data engineeringBachelor's degree in computer science, information systems, or information technology.Experience with scripting languages: Python, Scala, AWS Glue etc.Experience in Conceptual/Logical/Physical Data Modelling & expertise in Relational and Dimensional Data ModellingAdvanced SQL knowledge & performance tuning & cost optimization of complex SQL'sStrong experience with MPP databases (Teradata & Snowflake)Experience with Snow pipe, tasks, streams, clustering, Time travel, Cache, data sharingExperience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.Experience building and optimizing 'big data' data pipelines, architectures, and data sets.Experience with AWS cloud services - Athena, Quick sight, Kinesis, Lambda, IAM PoliciesExperienced in software delivery through continuous integration & automated deployments (for example git, bitbucket, Jenkins, etc.)Strong Experience with data pipeline and workflow management tools e.g., Airflow, RedwoodExperience with Atlassian Suite (JIRA, Confluence)Experience using and creating APIs.Experience supporting and working with cross-functional teams in a dynamic environment.Champions the capabilities and benefits of analytical data assets. Partner effectively across departments and stakeholdersMust be comfortable working in a Linux/Unix environment.Experience with ASW Analytics services like AWS Data Exchange, Data Pipeline, AWS Glue Data Brew, AWS Glue, AWS Lake Formation Familiarity with ASW Developer tools services like CodeDeploy, CodePipeline Experience with public/private API integration, web scrapping, data streaming architecture Knowledge of Business content interchange (BCI). Not Required but preferred experience: Public speaking and presentation skills.Experience with data science tools such as NumPy, Pandas, R, MATLAB etc.Experience with data processing engines like sparkExperience with DBT. How We Get Things Done... This last bit is probably the most important! Here at WBD, our guiding principles are the core values by which we operate and are central to how we get things done. You can find them at www.wbd.com/guiding-principles/ along with some insights from the team on what they mean and how they show up in their day to day. We hope they resonate with you and look forward to discussing them during your interview. The Legal Bits... Warner Bros. Discovery embraces the opportunity to build a workforce that reflects the diversity of our society and the world around us. Being an equal opportunity employer means that we take seriously our responsibility to consider qualified candidates on the basis of merit, regardless of sex, gender identity, ethnicity, age, sexual orientation, religion or belief, marital status, pregnancy, parenthood, disability or any other category protected by law.If you're a qualified candidate and you require adjustments or accommodations to search for a job opening or apply for a position, please contact us at [email protected]: . Date posted: 03/27/2024 11:58 AM
Sr Data Engineer, Ops Finance Transportation
Amazon, Hyderabad, Any
BASIC QUALIFICATIONS- 5+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQL- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS- Experience mentoring team members on best practices- - Design & Implementation of automated data contract and data quality enforcement mechanisms- - Expertise at least in 1 data Orchestration tool- - Working experience in CDKDESCRIPTIONThe Amazon transportation controllership team is looking for a Senior Data Engineer who is data-driven and detail oriented, to partner in expanding our financial data systems to support our global transportation network. You should have excellent business and communication skills to be able to work with business owners and tech leaders to gather infrastructure requirements, design data infrastructure, build up data pipelines and data-sets to meet business needs. You stay abreast of emerging technologies, investigating and implementing where appropriate. This person must be strategic and have strong analytical skills, robust interpersonal and influencing skills, strong organizational and project management skills, and is a self-starter. They will need to roll up their sleeves, work both independently and collaboratively across teams, and have a high level of ownership and accountabilityKey job responsibilities- Architect and develop end to end scalable data infrastructure and data pipelines- Develop data products, deploy highly performant solutions, build data infrastructure leveraging AWS services (such as EC2, Redshift, EMR, Lambda, Quicksight etc.)- Improve existing solutions and come up with next generation Data Architecture to improve scale, quality, timeliness, coverage, monitoring and security.- Develop new data models and end to data pipelines.- Lead design reviews for other Data Engineers on the team and actively participate in design reviews of related tech products.- Provide technical and thought leadership for Data Engineering and Business Intelligence- Create and implement Data Governance strategy for mitigating privacy and security risks- Design, implement, and support a platform providing secured access to large datasets.- Interface with multiple finance and accounting customers, gathering requirements and delivering complete data solutions.- Develop ETL pipeline that links various datasets that could serve the analysis objectives in the most efficient way- Analyze and solve problems at their root, stepping back to understand the broader context.- Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume using AWSA day in the lifeWork with the largest dataset in logistics management anywhere in the world to drive business insights, support operations and build analytical solutions for partners which can help drive cost control and decision making. As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments. You will design, implement and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine learning models, Gen Ai and ad-hoc data requests. You will be exposed to cutting edge AWS big data technologies.About the teamTrans Controllership in Finance is one of the most challenging and exciting spaces to work for, with new geographies, new modes and new carriers being launched every day and being required to seamlessly integrate with the Transportation technical systems for automatic Ingestion of Freight invoices, thorough auditing, timely payment and for proper accounting to keep our books clean and accurate. We are open to hiring candidates to work out of one of the following locations:Hyderabad, TS, INDPREFERRED QUALIFICATIONS- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience operating large data warehouses- Master's degree- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets- Knowledge of distributed systems as it pertains to data storage and computing- - Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations- - Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy- - Experience providing technical leadership and mentoring other engineers for best practices on data engineering- - Strong understanding and experience with DBMS internals.- - Strong understanding of system performance and scaling- - Knowledge on LLM and Gen Ai.Salary: . Date posted: 03/29/2024 09:27 AM
Sr Data Engineer, Ops Finance Transportation
Amazon, Hyderabad, TS, IN
DESCRIPTIONThe Amazon transportation controllership team is looking for a Senior Data Engineer who is data-driven and detail oriented, to partner in expanding our financial data systems to support our global transportation network. You should have excellent business and communication skills to be able to work with business owners and tech leaders to gather infrastructure requirements, design data infrastructure, build up data pipelines and data-sets to meet business needs. You stay abreast of emerging technologies, investigating and implementing where appropriate. This person must be strategic and have strong analytical skills, robust interpersonal and influencing skills, strong organizational and project management skills, and is a self-starter. They will need to roll up their sleeves, work both independently and collaboratively across teams, and have a high level of ownership and accountabilityKey job responsibilities- Architect and develop end to end scalable data infrastructure and data pipelines- Develop data products, deploy highly performant solutions, build data infrastructure leveraging AWS services (such as EC2, Redshift, EMR, Lambda, Quicksight etc.)- Improve existing solutions and come up with next generation Data Architecture to improve scale, quality, timeliness, coverage, monitoring and security.- Develop new data models and end to data pipelines.- Lead design reviews for other Data Engineers on the team and actively participate in design reviews of related tech products.- Provide technical and thought leadership for Data Engineering and Business Intelligence- Create and implement Data Governance strategy for mitigating privacy and security risks- Design, implement, and support a platform providing secured access to large datasets.- Interface with multiple finance and accounting customers, gathering requirements and delivering complete data solutions.- Develop ETL pipeline that links various datasets that could serve the analysis objectives in the most efficient way- Analyze and solve problems at their root, stepping back to understand the broader context.- Keep up to date with advances in big data technologies and run pilots to design the data architecture to scale with the increased data volume using AWSA day in the lifeWork with the largest dataset in logistics management anywhere in the world to drive business insights, support operations and build analytical solutions for partners which can help drive cost control and decision making. As a Data Engineer, you will be working in one of the world's largest and most complex data warehouse environments. You will design, implement and support scalable data infrastructure solutions to integrate with multi heterogeneous data sources, aggregate and retrieve data in a fast and safe mode, curate data that can be used in reporting, analysis, machine learning models, Gen Ai and ad-hoc data requests. You will be exposed to cutting edge AWS big data technologies.About the teamTrans Controllership in Finance is one of the most challenging and exciting spaces to work for, with new geographies, new modes and new carriers being launched every day and being required to seamlessly integrate with the Transportation technical systems for automatic Ingestion of Freight invoices, thorough auditing, timely payment and for proper accounting to keep our books clean and accurate. We are open to hiring candidates to work out of one of the following locations:Hyderabad, TS, INDBASIC QUALIFICATIONS- 5+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQL- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS- Experience mentoring team members on best practices- - Design & Implementation of automated data contract and data quality enforcement mechanisms- - Expertise at least in 1 data Orchestration tool- - Working experience in CDKPREFERRED QUALIFICATIONS- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience operating large data warehouses- Master's degree- Experience building/operating highly available, distributed systems of data extraction, ingestion, and processing of large data sets- Knowledge of distributed systems as it pertains to data storage and computing- - Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations- - Proven success in communicating with users, other technical teams, and senior management to collect requirements, describe data modeling decisions and data engineering strategy- - Experience providing technical leadership and mentoring other engineers for best practices on data engineering- - Strong understanding and experience with DBMS internals.- - Strong understanding of system performance and scaling- - Knowledge on LLM and Gen Ai.
Analyst, Data Engineer
TTEC, Andhra Pradesh, Hyderabad
TEC Digital Consulting’sInsights Practice is looking for a Data Engineer who is passionate aboutsolving complex data problems and intricate engineering issues with largesystems. We combine human insightand the speed of technology to transform our clients’ interactions with theircustomers. Advanced analytics of the customer experience and customerinteractions is our expertise. What you’ll be doing: The data engineer will be responsible for all aspects of executionand delivery for new and ongoing client implementations of the analyticplatform. This will require working with clients and coordinating with internalbusiness consulting, analyst, data science, and technology teams. Primary Responsibilities: Technical and functional analysis of customer implementation and integration requirementsDocumentation of implementation requirements and expected effortConfiguration and setup of the analytics platformConfiguration of data loaders and development and configuration of workflow processes and customizations to the platformParticipate in testingProactive identification of internal and external dependencies, highlighting issues, scope changes, and progress against project planCommunication of project status/issues to clients and internal managementPartner with various internal teamsProvide technical support to assist clients and partners during and post implementation. Required Experience and Skills:Bachelor’s Degree in Computer Science, Information Systems or related with 2-3 years of relevant experienceIn-depth familiarity with Big data technology and its application.Proficiency with the Azure or AWS ecosystemExperience with Big Data ETLUnderstanding of complex data flows, identification of data processing bottlenecks and designing and implementing solutions.Proficiency in .NET, C#, Python, Linux bash, Power Shell.Experienced in consuming third-party REST APIs (JSON) and SDKsA broad set of technical skills and knowledge across hardware, software, systems and solutions development and across more than one technical domain.Experienced in U SQL, PostgreSQ, TSQL Experience in professional services or technical consulting with enterprise software solutions, specifically enterprise software installation, configuration, customization, and testing.Proven ability to balance and manage multiple, competing priorities.Collaborative interpersonal skills and ability to work within cross-functional teams.Self-starter who relies on experience and judgment to plan and accomplish goals in complex fast-paced environment to ensure quality of all data integration points.Excellent customer service skills.Creative problem-solving and analysis skills.Ability to handle problem situations quickly, inventively, and resourcefully.Project management skills including:Ability to prioritize and manage tasksAbility to plan, commit, and deliver to schedulesAbility to identify, escalate, and manage project issuesWillingness to work extended hours on an as-needed basisEmployment Requirements: TTEC requires all employees hired in the India to successfully pass a background check including employment credentials, education, permanent and current address verification and if applicable, immigration and work permit documentation as a condition of employment. Depending on location and client program, a drug test may also be required as a condition of employment. TTEC is an Equal Opportunity Employer. All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status. You will be asked to share with TTEC as well as its representatives, all such personal information that it may require to conduct such background verification and also agree to TTEC and its representatives collecting and storing such personal information and transferring the same, whether in India or abroad.
Data Engineer I, SCOT - AIM
Amazon, Hyderabad, Any
DESCRIPTIONSCOT's Automated Inventory Management (AIM) team is seeking talented individuals who enjoy the challenge of diving into complex problems and solving the unsolvable to help our executives make impactful business decisions. AIM teams owns Availability , Speed, Inventory & Auditing at Scale metrics that measures & improves the overall customer experience. We regularly work directly with executive leadership to improve that experience.As a Data Engineer, you will analyze large amounts of business data, solve real world problems, and develop metrics and business cases that will enable us to continually delight our customers worldwide. In this role, you will work closely with a team of Business Intelligence Engineers, Data Engineers and Data Scientists to automate and architect data pipelines, and to make the data more actionable to manage business at scale. Successful candidates will bring strong technical abilities combined with a passion for delivering results for customers, internal and external.Key job responsibilities• Participate in the full development cycle for ETL: design, implementation, validation, documentation, and maintenance .• Build and improve Data solutions by translating business requirements into robust, scalable, and supportable solutions that work well within the overall system architecture.• Own the design, development, and maintenance of ongoing metrics, reports, analyses, and dashboards to drive key business decisions.• Monitor and troubleshoot operational or data issues in the data pipelines.We are open to hiring candidates to work out of one of the following locations:Bangalore, KA, IND | Hyderabad, TS, INDBASIC QUALIFICATIONS- 1+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with one or more query language (e.g., SQL, PL/SQL, DDL, MDX, HiveQL, SparkSQL, Scala)- Experience with one or more scripting language (e.g., Python, KornShell)PREFERRED QUALIFICATIONS- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience as a data engineer or related specialty (e.g., software engineer, business intelligence engineer, data scientist) with a track record of manipulating, processing, and extracting value from large datasetsSalary: . Date posted: 04/06/2024 09:32 AM
Software Engineer III- Big Data
JPMorgan Chase, Hyderabad, Any
We have an exciting and rewarding opportunity for you to take your software engineering career to the next level. As a Software Engineer III at JPMorgan Chase within the Consumer and community banking - Data Technology, you serve as a seasoned member of an agile team to design and deliver trusted market-leading technology products in a secure, stable, and scalable way. You are responsible for carrying out critical technology solutions across multiple technical areas within various business functions in support of the firm's business objectives.Job responsibilities Executes software solutions, design, development, and technical troubleshooting with ability to think beyond routine or conventional approaches to build solutions or break down technical problems Creates secure and high-quality production code and maintains algorithms that run synchronously with appropriate systems Produces architecture and design artifacts for complex applications while being accountable for ensuring design constraints are met by software code development Gathers, analyzes, synthesizes, and develops visualizations and reporting from large, diverse data sets in service of continuous improvement of software applications and systems Proactively identifies hidden problems and patterns in data and uses these insights to drive improvements to coding hygiene and system architecture Contributes to software engineering communities of practice and events that explore new and emerging technologies Adds to team culture of diversity, equity, inclusion, and respectRequired qualifications, capabilities, and skills 8 Years of relevant experience Hands-on practical experience in system design, application development, testing, and operational stability Should be able to lead by example and guide the team with his/her technical expertise Should be able to identify risks/issues for the project and manage them accordingly People management skills would be given preference but is not mandatory Knowledge or experience on ETL technologies like Informatica or Ab-initio would be preferable.Preferred qualifications, capabilities, and skills Should be able to independently design, build, test and deploy the code Should be able to lead by example and guide the team with his/her technical expertise Should be able to identify risks/issues for the project and manage them accordingly People management skills would be given preference but is not mandatory Knowledge or experience on ETL technologies like Informatica or Ab-initio would be preferable.About usJPMorgan Chase & Co., one of the oldest financial institutions, offers innovative financial solutions to millions of consumers, small businesses and many of the world's most prominent corporate, institutional and government clients under the J.P. Morgan and Chase brands. Our history spans over 200 years and today we are a leader in investment banking, consumer and small business banking, commercial banking, financial transaction processing and asset management.We recognize that our people are our strength and the diverse talents they bring to our global workforce are directly linked to our success. We are an equal opportunity employer and place a high value on diversity and inclusion at our company. We do not discriminate on the basis of any protected attribute, including race, religion, color, national origin, gender, sexual orientation, gender identity, gender expression, age, marital or veteran status, pregnancy or disability, or any other basis protected under applicable law. We also make reasonable accommodations for applicants' and employees' religious practices and beliefs, as well as mental health or physical disability needs. Visit our FAQs for more information about requesting an accommodation.About the TeamOur Consumer & Community Banking division serves our Chase customers through a range of financial services, including personal banking, credit cards, mortgages, auto financing, investment advice, small business loans and payment processing. We're proud to lead the U.S. in credit card sales and deposit growth and have the most-used digital solutions - all while ranking first in customer satisfaction.Salary: . Date posted: 04/08/2024 10:22 PM
Sr. Data Engineer
Amazon, Hyderabad, TS, IN
DESCRIPTIONAre you passionate about data and code? Does the prospect of dealing with massive volumes of data excite you? Do you want to build data engineering solutions that process billions of records and supports handling of translations data using AWS technologies? Do you want to create the next-generation product for self-service data transformation? If so, Translation Services team is for you!The goal of Intech Translation Services (TS) team is to provide high quality, on-time translations to Amazon business teams, enabling them to expand globally at scale. Our team has a direct impact on retail CX, a key component that runs our Amazon fly wheel.As a Data Engineer, you would own the architecture of DW solutions for the Enterprise using multiple platforms. You would have the opportunity to lead the design, creation and management of extremely large datasets working backwards from business use case. You would use your strong business and communication skills to be able to work with business analysts and engineers to determine how best to design the data warehouse for reporting and analytics. You will be responsible for designing and implementing scalable ETL processes in the data warehouse platform to support the rapidly growing and dynamic business demand for data, and use it to deliver the data as service which will have an immediate influence on day-to-day decision making. Key job responsibilities- Develop data products, infrastructure and data pipelines leveraging AWS services (such as Redshift, Kinesis, EMR, Lambda etc.) and internal BDT tools (Datanet, Cradle, QuickSight etc.- Improve existing solutions and come up with next generation Data Architecture to improve scale, quality, timeliness, coverage, monitoring and security.- Develop new data models and end to data pipelines.- Lead design reviews for other Data Engineers on the team and actively participate in design reviews of related tech products.- Provide technical and thought leadership for Data Engineering and Business Intelligence within TS org.- Create and implement Data Governance strategy for mitigating privacy and security risksWe are open to hiring candidates to work out of one of the following locations:Hyderabad, TS, INDBASIC QUALIFICATIONS- 5+ years of data engineering experience- Experience with data modeling, warehousing and building ETL pipelines- Experience with SQL- Experience in at least one modern scripting or programming language, such as Python, Java, Scala, or NodeJS- Experience mentoring team members on best practicesPREFERRED QUALIFICATIONS- Experience with big data technologies such as: Hadoop, Hive, Spark, EMR- Experience operating large data warehouses
Software Engineer II
Microsoft Games, Hyderabad, Any
Are you excited about the possibility of working on a high-performance team on the largest Object Storage service in the world? Azure Storage team is chartered with building, managing and running Cloud Storage for Microsoft Azure Cloud. The team works on distributed systems scaling to Exabyte of storage in data centers around the world.Azure Storage provides the persistent storage layer in the cloud, powering millions of Azure virtual machines, holding millions of hours of video, billions of photos and petabytes of other data types. Azure Storage is one of the foundational services in the Azure Cloud and consists of a Storage Platform which currently powers various different storage services including Blob Storage, Table Storage (NoSql Key Value store), Queue Storage, File Storage (new SMB based File Storage), Disk Storage and Data Lake Store (HDFS compliant) which support a variety of storage and analytic workloads. The service hosts data from some of the largest companies in the world plus supports all of Microsoft's largest online businesses including Xbox, Skype and Bing and has scaled to store exabytes of customer data with the roadmap looking even better in terms of growth. As part of this team you will work on the biggest of the big data services in Microsoft, live the services culture, embrace and learn in a fast paced, live-site focused environment delivering customer value with everything we do. You can read more about Azure storage. Microsoft's mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.Responsibilities Performance Analysis and Optimization: Conduct in-depth performance analysis of Azure Storage Services components, including Blob Storage, File Storage, Queue Storage, and Table Storage. Identify performance bottlenecks, analyze system behavior under various workloads, and collaborate with cross-functional teams to optimize system performance. Benchmarking and Testing: Develop and execute comprehensive performance testing strategies to evaluate the scalability, reliability, and responsiveness of Azure Storage Services. Design and implement automated testing frameworks, tools, and methodologies to simulate real-world scenarios and validate system performance. Capacity Planning and Scaling: Work closely with product management and engineering teams to forecast capacity requirements, plan for future growth, and scale Azure Storage Services infrastructure to meet evolving customer demands. Utilize predictive modeling and performance profiling techniques to anticipate resource needs and optimize resource utilization. Performance Tuning and Profiling: Utilize profiling tools and performance monitoring techniques to diagnose performance issues, analyze system behavior, and fine-tune system parameters for optimal performance. Collaborate with software engineers to implement performance enhancements and refactor code for improved efficiency. Troubleshooting and Root Cause Analysis: Investigate performance-related incidents, triage performance issues, and perform root cause analysis to identify underlying causes. Develop remediation strategies, implement performance optimizations, and ensure timely resolution of performance-related issues to maintain high service reliability. Continuous Improvement: Drive a culture of continuous improvement by proactively identifying opportunities to enhance system performance, reliability, and scalability. Champion best practices for performance engineering, mentor junior team members, and contribute to the development of performance-related tools, processes, and methodologies. Cross-Functional Collaboration: Collaborate with cross-functional teams, including software engineering, architecture, operations, and customer support, to align performance goals with business objectives. Communicate performance insights, recommendations, and progress updates to stakeholders at all levels of the organization. QualificationsRequired Qualifications: Bachelor's Degree in Computer Science or related technical field with Computer Science and engineering fundamentals and ability/interest in learning new technologies AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. 3+ years of experience in developing quality products and services, preferably in systems and backend services, AND systems programming, operating systems, distributed systems, databases, cloud services, multi-threaded systems AND design and problem-solving Other Qualifications: Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud Background Check upon hire/transfer and every two years thereafter. Preferred Qualifications: Bachelor's Degree in Computer Science OR related technical field with Computer Science and engineering fundamentals and ability/interest in learning modern technologies AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field ith Computer Science and engineering fundamentals and ability/interest in learning modern technologies AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience. Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations and ordinances. We also consider qualified applicants regardless of criminal histories, consistent with legal requirements. If you need assistance and/or a reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form . Benefits/perks listed below may vary depending on the nature of your employment with Microsoft and the country where you work. #azurecorejobs #azstorageIDCSalary: . Date posted: 04/11/2024 03:14 AM