Frank Kane's Taming Big Data with Apache Spark and Python

2017-06-30 Computers

Author : Frank Kane
Release : 2017-06-30
Genre : Computers
Kind : eBook
Book Rating : 307/5 ( reviews)

GET EBOOK

Book Synopsis Frank Kane's Taming Big Data with Apache Spark and Python by : Frank Kane

Download or read book Frank Kane's Taming Big Data with Apache Spark and Python written by Frank Kane. This book was released on 2017-06-30. Available in PDF, EPUB and Kindle. Book excerpt: Frank Kane's hands-on Spark training course, based on his bestselling Taming Big Data with Apache Spark and Python video, now available in a book. Understand and analyze large data sets using Spark on a single system or on a cluster. About This Book Understand how Spark can be distributed across computing clusters Develop and run Spark jobs efficiently using Python A hands-on tutorial by Frank Kane with over 15 real-world examples teaching you Big Data processing with Spark Who This Book Is For If you are a data scientist or data analyst who wants to learn Big Data processing using Apache Spark and Python, this book is for you. If you have some programming experience in Python, and want to learn how to process large amounts of data using Apache Spark, Frank Kane's Taming Big Data with Apache Spark and Python will also help you. What You Will Learn Find out how you can identify Big Data problems as Spark problems Install and run Apache Spark on your computer or on a cluster Analyze large data sets across many CPUs using Spark's Resilient Distributed Datasets Implement machine learning on Spark using the MLlib library Process continuous streams of data in real time using the Spark streaming module Perform complex network analysis using Spark's GraphX library Use Amazon's Elastic MapReduce service to run your Spark jobs on a cluster In Detail Frank Kane's Taming Big Data with Apache Spark and Python is your companion to learning Apache Spark in a hands-on manner. Frank will start you off by teaching you how to set up Spark on a single system or on a cluster, and you'll soon move on to analyzing large data sets using Spark RDD, and developing and running effective Spark jobs quickly using Python. Apache Spark has emerged as the next big thing in the Big Data domain – quickly rising from an ascending technology to an established superstar in just a matter of years. Spark allows you to quickly extract actionable insights from large amounts of data, on a real-time basis, making it an essential tool in many modern businesses. Frank has packed this book with over 15 interactive, fun-filled examples relevant to the real world, and he will empower you to understand the Spark ecosystem and implement production-grade real-time Spark projects with ease. Style and approach Frank Kane's Taming Big Data with Apache Spark and Python is a hands-on tutorial with over 15 real-world examples carefully explained by Frank in a step-by-step manner. The examples vary in complexity, and you can move through them at your own pace.

Taming Big Data with Apache Spark and Python--Hands On!

2016

Author : Frank Kane
Release : 2016
Genre :
Kind : eBook
Book Rating : 931/5 ( reviews)

GET EBOOK

Book Synopsis Taming Big Data with Apache Spark and Python--Hands On! by : Frank Kane

Download or read book Taming Big Data with Apache Spark and Python--Hands On! written by Frank Kane. This book was released on 2016. Available in PDF, EPUB and Kindle. Book excerpt: "Apache Spark has emerged as the next big thing in the Big Data domain -- quickly rising from an ascending technology to an established superstar in just a matter of years. Spark allows you to quickly extract actionable insights from large amounts of data, on a real-time basis. This course will be your companion to learn Apache Spark in a hands-on manner. Start with understanding how to set up Spark on a single system or on a cluster. From analyzing large data sets using Spark RDD, to developing and running effective Spark jobs quickly using Python, this course will teach you everything. Packed with over 15 interactive, fun-filled examples relevant to the real-world, the course will empower you to understand the Spark ecosystem and implement production-grade real-time Spark projects with ease."--Resource description page.

Buyology

2010-02-02 Business & Economics

Author : Martin Lindstrom
Release : 2010-02-02
Genre : Business & Economics
Kind : eBook
Book Rating : 890/5 ( reviews)

GET EBOOK

Book Synopsis Buyology by : Martin Lindstrom

Download or read book Buyology written by Martin Lindstrom. This book was released on 2010-02-02. Available in PDF, EPUB and Kindle. Book excerpt: NEW YORK TIMES BESTSELLER • “A fascinating look at how consumers perceive logos, ads, commercials, brands, and products.”—Time How much do we know about why we buy? What truly influences our decisions in today’s message-cluttered world? In Buyology, Martin Lindstrom presents the astonishing findings from his groundbreaking three-year, seven-million-dollar neuromarketing study—a cutting-edge experiment that peered inside the brains of 2,000 volunteers from all around the world as they encountered various ads, logos, commercials, brands, and products. His startling results shatter much of what we have long believed about what captures our interest—and drives us to buy. Among the questions he explores: • Does sex actually sell? • Does subliminal advertising still surround us? • Can “cool” brands trigger our mating instincts? • Can our other senses—smell, touch, and sound—be aroused when we see a product? Buyology is a fascinating and shocking journey into the mind of today's consumer that will captivate anyone who's been seduced—or turned off—by marketers' relentless attempts to win our loyalty, our money, and our minds.

Scala Programming for Big Data Analytics

2019-07-05 Business & Economics

Author : Irfan Elahi
Release : 2019-07-05
Genre : Business & Economics
Kind : eBook
Book Rating : 104/5 ( reviews)

GET EBOOK

Book Synopsis Scala Programming for Big Data Analytics by : Irfan Elahi

Download or read book Scala Programming for Big Data Analytics written by Irfan Elahi. This book was released on 2019-07-05. Available in PDF, EPUB and Kindle. Book excerpt: Gain the key language concepts and programming techniques of Scala in the context of big data analytics and Apache Spark. The book begins by introducing you to Scala and establishes a firm contextual understanding of why you should learn this language, how it stands in comparison to Java, and how Scala is related to Apache Spark for big data analytics. Next, you’ll set up the Scala environment ready for examining your first Scala programs. This is followed by sections on Scala fundamentals including mutable/immutable variables, the type hierarchy system, control flow expressions and code blocks. The author discusses functions at length and highlights a number of associated concepts such as functional programming and anonymous functions. The book then delves deeper into Scala’s powerful collections system because many of Apache Spark’s APIs bear a strong resemblance to Scala collections. Along the way you’ll see the development life cycle of a Scala program. This involves compiling and building programs using the industry-standard Scala Build Tool (SBT). You’ll cover guidelines related to dependency management using SBT as this is critical for building large Apache Spark applications. Scala Programming for Big Data Analytics concludes by demonstrating how you can make use of the concepts to write programs that run on the Apache Spark framework. These programs will provide distributed and parallel computing, which is critical for big data analytics. What You Will LearnSee the fundamentals of Scala as a general-purpose programming languageUnderstand functional programming and object-oriented programming constructs in ScalaUse Scala collections and functions Develop, package and run Apache Spark applications for big data analyticsWho This Book Is For Data scientists, data analysts and data engineers who intend to use Apache Spark for large-scale analytics. /div

Data Pipelines with Apache Airflow

2021-04-05 Computers

Author : Julian de Ruiter
Release : 2021-04-05
Genre : Computers
Kind : eBook
Book Rating : 831/5 ( reviews)

GET EBOOK

Book Synopsis Data Pipelines with Apache Airflow by : Julian de Ruiter

Download or read book Data Pipelines with Apache Airflow written by Julian de Ruiter. This book was released on 2021-04-05. Available in PDF, EPUB and Kindle. Book excerpt: "An Airflow bible. Useful for all kinds of users, from novice to expert." - Rambabu Posa, Sai Aashika Consultancy Data Pipelines with Apache Airflow teaches you how to build and maintain effective data pipelines. A successful pipeline moves data efficiently, minimizing pauses and blockages between tasks, keeping every process along the way operational. Apache Airflow provides a single customizable environment for building and managing data pipelines, eliminating the need for a hodgepodge collection of tools, snowflake code, and homegrown processes. Using real-world scenarios and examples, Data Pipelines with Apache Airflow teaches you how to simplify and automate data pipelines, reduce operational overhead, and smoothly integrate all the technologies in your stack. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the technology Data pipelines manage the flow of data from initial collection through consolidation, cleaning, analysis, visualization, and more. Apache Airflow provides a single platform you can use to design, implement, monitor, and maintain your pipelines. Its easy-to-use UI, plug-and-play options, and flexible Python scripting make Airflow perfect for any data management task. About the book Data Pipelines with Apache Airflow teaches you how to build and maintain effective data pipelines. You’ll explore the most common usage patterns, including aggregating multiple data sources, connecting to and from data lakes, and cloud deployment. Part reference and part tutorial, this practical guide covers every aspect of the directed acyclic graphs (DAGs) that power Airflow, and how to customize them for your pipeline’s needs. What's inside Build, test, and deploy Airflow pipelines as DAGs Automate moving and transforming data Analyze historical datasets using backfilling Develop custom components Set up Airflow in production environments About the reader For DevOps, data engineers, machine learning engineers, and sysadmins with intermediate Python skills. About the author Bas Harenslak and Julian de Ruiter are data engineers with extensive experience using Airflow to develop pipelines for major companies. Bas is also an Airflow committer. Table of Contents PART 1 - GETTING STARTED 1 Meet Apache Airflow 2 Anatomy of an Airflow DAG 3 Scheduling in Airflow 4 Templating tasks using the Airflow context 5 Defining dependencies between tasks PART 2 - BEYOND THE BASICS 6 Triggering workflows 7 Communicating with external systems 8 Building custom components 9 Testing 10 Running tasks in containers PART 3 - AIRFLOW IN PRACTICE 11 Best practices 12 Operating Airflow in production 13 Securing Airflow 14 Project: Finding the fastest way to get around NYC PART 4 - IN THE CLOUDS 15 Airflow in the clouds 16 Airflow on AWS 17 Airflow on Azure 18 Airflow in GCP

Popular eBooks

Frank Kane's Taming Big Data with Apache Spark and Python

Taming Big Data with Apache Spark and Python--Hands On!

Buyology

Scala Programming for Big Data Analytics

Data Pipelines with Apache Airflow

You may also like...