- Table View
- List View
Space and Geospatial Technologies for the Africa We Want: 13th International Conference of the African Association of Remote Sensing of the Environment (Southern Space Studies)
by Souleye Wade Jossam Potel Kamal Labbassi Solomon Tesfamichael Harold Annegarn Jide KufoniyiThis book comprises the contributions of the African Association of Remote Sensing of the Environment (AARSE) international conference which is conducted biennially across Africa, alternately with the AfricaGIS conference. It is the premier forum in Africa for research on remote sensing technologies and geospatial information science, gathering leading scholars from the remote sensing and related communities. The 13th AARSE International Conference was held on October 24-28, 2022 in Kigali, Rwanda, to focus on Earth observations and geospatial science to achieve the Sustainable Development Goals. The five-day event themed “Space and Geospatial Technologies for the Africa We Want” was organized by the African Association of Remote Sensing of the Environment (AARSE) and the Institut d’Enseignement Supérieur de Ruhengeri (Ines-Ruhengeri) in partnership with Rwanda Space Agency and Space in Africa. Furthermore, the conference was sponsored by GMES and Africa, the Regional Centre For Mapping Of Resources For Development (RCMRD), Airbus, European Space Agency (ESA), Digital Earth Africa, and INES-Ruhengeri and Rwanda Space Agency. The 13th Conference continues a long series of successful AARSE conferences which started in 1996, in Harare (Zimbabwe), and has been held in Abidjan (Cote D'Ivoire) in 1998, Cape Town (South Africa) in 2000, Abuja (Nigeria) in 2002, Nairobi (Kenya) in 2004, Cairo (Egypt) in 2006, Accra (Ghana) in 2008, Addis Abeba (Ethiopia) in 2010, El Jadida (Morocco) in 2012, Johannesburg (South Africa) in 2014, Kampala (Ouganda) in 2016, and in Alexandria (Egypt) in 2018. The book is mainly addressed to practitioners and experts from academia, politics, and industry.
Space and Play in Japanese Videogame Arcades (Routledge Contemporary Japan Series)
by Jérémie Pelletier-GagnonThis book presents a scholarly investigation of the development and culture of Japanese videogame arcades, both from a historical and contemporary point of view.Providing an overview of the historical evolution of public amusement spaces from the early rooftop amusement spaces from the early nineteenth century to the modern multi‑floor and interconnected arcade complexes that characterize the urban fabric of contemporary Japan, the book argues that arcade videogames and their associated practices must be examined in the context in which they are played, situated in the interrelation between the game software, the cabinets as material conditions of play, and the space of the venue that frames the experience. Including three case studies of distinct and significant game centres located in Tokyo and Kyoto, the book addresses of play in public, including the notion of performance and observation as play practices, spatial appropriation, as well as the compartmentalization of the play experience.In treating videogames as sets of circumstances, the book identifies the opportunities for ludic practices that videogame arcades provide in Japan. As such, it will appeal to students and scholars of Game Studies and Digital Media Studies, as well as those of Japanese Culture and Society.
Space, Place and Global Digital Work
by Jörg FleckerThis edited volume seeks to enhance our understanding of the concepts of space and place in the study of digital work. It argues that while digital work is often presented as 'placeless', work always takes place somewhere with a certain degree of local embeddedness. Contributors to this collection address restructuring processes that bring about delocalised digital work and point out limitations to dislocation inherent in the work itself, and the social relations or the physical artefacts involved. Exploring the dynamics of global value chains and shifts in the international division of labour, this book explores the impact these have on employment and working conditions, workers' agency in shaping and coping with changes in work, and the new competencies needed in virtual organisational environments. Combining different disciplinary perspectives, the volume teases out the spatial aspects of digital work at different scales ranging from team level to that of global production networks.
Space-Air-Ground Integrated Network Security
by Wei Zhang Lin Bai Chunxiao Jiang Jianwei LiuThis book focuses on security science and technology, data and information security, and mobile and network security for space-air-ground integrated networks (SAGINs). SAGIN are expected to play an increasingly important role in providing real-time, flexible, and integrated communication and data transmission services in an efficient manner. Today, SAGINs have been widely developed for a range of applications in navigation, environmental monitoring, traffic management, counter-terrorism, etc. However, security becomes a major concern, since the satellites, spacecrafts, and aircrafts are susceptible to a variety of traditional/specific network-based attacks, including eavesdropping, session hijacking, and illegal access. In this book, we review the theoretical foundations of SAGIN security. We also address a range of related security threats and provide cutting-edge solutions in the aspect of ground network security, airborne network security, space network security, and provide future trends in SAGIN security. The book goes from an introduction to the topic’s background, to a description of the basic theory, and then to cutting-edge technologies, making it suitable for readers at all levels including professional researchers and beginners. To gain the most from the book, readers should have taken prior courses in information theory, cryptography, network security, etc.
Space-Filling Curves
by Michael BaderThe present book provides an introduction to using space-filling curves (SFC) as tools in scientific computing. Special focus is laid on the representation of SFC and on resulting algorithms. For example, grammar-based techniques are introduced for traversals of Cartesian and octree-type meshes, and arithmetisation of SFC is explained to compute SFC mappings and indexings. The locality properties of SFC are discussed in detail, together with their importance for algorithms. Templates for parallelisation and cache-efficient algorithms are presented to reflect the most important applications of SFC in scientific computing. Special attention is also given to the interplay of adaptive mesh refinement and SFC, including the structured refinement of triangular and tetrahedral grids. For each topic, a short overview is given on the most important publications and recent research activities.
Space-Time Geometries for Motion and Perception in the Brain and the Arts (Lecture Notes in Morphogenesis)
by Alain Berthoz Tamar FlashThis book is based on a two-day symposium at the Paris Institute of Advanced Study titled "space-time geometries and movement in the brain and the arts". It includes over 20 chapters written by the leading scientists and artists who presented their related research studies at the symposium and includes six sections; the first three focus on space-time geometries in perception, action and memory while the last three focus on specific artistic domains: drawing and painting, dance, music, digital arts and robotics. The book is accompanied by a dedicated webpage including related images and videos. There is an ever-growing interest in the topics covered by this book. Space and time are of fundamental importance for our understanding of human perception, action, memory and cognition, and are entities which are equally important in physics, biology, neuroscience and psychology. Highly prominent scientists and mathematicians have expressed their belief that our bodies and minds shape the ways we perceive space and time and the physical laws we formulate. Understanding how the brain perceives motion and generates -bodily movements is of great significance. There is also growing interest in studying how space, time and movement subserve artistic creations in different artistic modalities (e.g., fine arts, digital and performing arts and music). This interest is inspired by the idea that artists make intuitive use of the principles and simplifying strategies used by the brain in movement generation and perception. Building upon new understanding of the spatio-temporal geometries subserving movement generation and perception by the brain we can start exploring how artists make use of such neuro --geometrical and neuro-dynamic representations in order to express artistic concepts and emotionally affect the human observers and listeners. Scientists have also started formulating new ideas of how aesthetic judgements emerge from the principles and brain mechanisms subserving motor control and motion perception.Covering novel and multidisciplinary topics, this advanced book will be of interest to neuroscientists, behavioral scientists, artificial intelligence and robotics experts, students and artists.
Spaceborne Synthetic Aperture Radar Remote Sensing: Techniques and Applications
by Shashi Kumar Paul Siqueira Himanshu Govil Shefali AgrawalThis book provides basic and advanced concepts of synthetic aperture radar (SAR), PolSAR, InSAR, PolInSAR, and all necessary information about various applications and analysis of data of multiple sensors. It includes information on SAR remote sensing, data processing, and separate applications of SAR technology, compiled in one place. It will help readers to use active microwave imaging sensor-based information in geospatial technology and applications.This book: Covers basic and advanced concepts of synthetic aperture radar (SAR) remote sensing Introduces spaceborne SAR sensors Discusses applications of SAR remote sensing in earth observation Explores utilization of SAR data for solid earth, ecosystem, and cryosphere, including imaging of extra-terrestrial bodies Includes PolSAR and PolInSAR for aboveground forest biomass retrieval, as well as InSAR and PolSAR for snow parameters retrieval This book is aimed at researchers and graduate students in remote sensing, photogrammetry, geoscience, image processing, agriculture, environment, forestry, and image processing.
Spaces Mapped and Monstrous: Digital 3D Cinema and Visual Culture (Film and Culture Series)
by Nick JonesDigital 3D has become a core feature of the twenty-first-century visual landscape. Yet 3D cinema is a contradictory media form: producing spaces that are highly regimented and exhaustively detailed, it simultaneously relies upon distortions of vision and space that are inherently strange.Spaces Mapped and Monstrous explores the paradoxical nature of 3D cinema to offer a critical analysis of an inescapable part of contemporary culture. Considering 3D’s distinctive visual qualities and its connections to wider digital systems, Nick Jones situates the production and exhibition of 3D cinema within a web of aesthetic, technological, and historical contexts. He examines 3D’s relationship with computer interfaces, virtual reality, and digital networks as well as tracing its lineage to predigital models of visual organization. Jones emphasizes that 3D is not only a technology used in films but also a tool for producing, controlling, and distorting space within systems of surveillance, corporatization, and militarization. The book features detailed analysis of a wide range of films—including Avatar (2009), Goodbye to Language (2014), Love (2015), and Clash of the Titans (2010)—demonstrating that 3D is not merely an augmentation of 2D cinema but that it has its own unique properties. Spaces Mapped and Monstrous brings together media archaeology, digital theory, and textual analysis to provide a new account of the importance of 3D to visual culture today.
Spaces of Teaching and Learning
by Peter Goodyear Robert A. EllisThis integrated collection of perspectives on the spaces of teaching and learning uses ‘learning space’ to place educational practice in context. It considers the complex relationships involved in the design, management and use of contemporary learning spaces. It sheds light on some of the problems of connecting the characteristics of spaces to the practices and outcomes of teaching and learning. The contributions show how research into learning spaces can inform broader educational practices and how the practices of teaching, learning and design can inform research. The selection of chapters demonstrates the value of gathering together multiple sources of evidence, viewed through different epistemological lenses in order to push the field forward in a timely fashion. The book provides both a broad review of current practices as well as a deep-dive into particular educational and epistemological challenges that the various approaches adopted entail. Contrasts and commonalities between the different approaches emphasise the importance of developing a broad, robust evidence-base for practice in context. This is the inaugural book in the series Understanding Teaching-Learning Practice.
Space–Time Computational Flow Analysis: A Chronological Catalog of Unconventional Methods and First-of-Its-Kind Solutions (Modeling and Simulation in Science, Engineering and Technology)
by Tayfun E. Tezduyar Kenji TakizawaSpace–Time Computational Flow Analysis (STCFA) was developed in 1990 in the context of flows with moving boundaries and interfaces, which is a wide class of problems that includes fluid–particle interactions, fluid–structure interactions (FSI), and free-surface and multi-fluid flows. It is a computational framework made of unconventional methods, which have evolved over the years as more unconventional methods were introduced to increase its scope and accuracy. It brought first-of-its-kind solutions in many classes of problems, including fluid–particle interactions in particle-laden flows, FSI in parachute aerodynamics, flapping-wing aerodynamics of an actual locust, ventricle-valve-aorta flow analysis, and car and tire aerodynamics. With these successes in so many classes of problems, the STCFA has reached a level of remarkable sophistication, scope, and practical value. This monograph presents, for the first time, a chronological catalog of STCFA methods and solutions from their development to the present. Part I focuses on the STCFA in the context of finite element analysis, and Part II in the context of isogeometric analysis. The methods presented include complementary general-purpose methods that were introduced in the evolution of STCFA. All researchers working on or interested in space–time computations in fluid mechanics, FSI, and solid mechanics, including graduate students, will benefit from the wealth of powerful computational methods and impressive solutions they will find in the book.
Space–Time Conservation Element and Solution Element Method: Advances and Applications in Engineering Sciences (Engineering Applications of Computational Methods #13)
by Chih-Yung Wen Yazhong Jiang Lisong ShiThis open access book introduces the fundamentals of the space–time conservation element and solution element (CESE) method, which is a novel numerical approach for solving equations of physical conservation laws. It highlights the recent progress to establish various improved CESE schemes and its engineering applications. With attractive accuracy, efficiency, and robustness, the CESE method is particularly suitable for solving time-dependent nonlinear hyperbolic systems involving dynamical evolutions of waves and discontinuities. Therefore, it has been applied to a wide spectrum of problems, e.g., aerodynamics, aeroacoustics, magnetohydrodynamics, multi-material flows, and detonations. This book contains algorithm analysis, numerical examples, as well as demonstration codes. This book is intended for graduate students and researchers who are interested in the fields such as computational fluid dynamics (CFD), mechanical engineering, and numerical computation.
Spam Kings: The Real Story Behind the High-Rolling Hucksters Pushing Porn, Pills, and %*@)# Enlargements
by Brian S McWilliams"People are stupid, Davis Wolfgang Hawke thought as he stared at the nearly empty box of Swastika pendants on his desk." So begins Spam Kings, an investigative look into the shady world of email spammers and the people trying to stop them.This compelling exposé explores the shadowy world of the people responsible for today’s junk-email epidemic. Investigative journalist Brian McWilliams delivers a fascinating account of the cat-and-mouse game played by spam entrepreneurs in search of easy fortunes and anti-spam activists.McWilliams chronicles the activities of several spam kings, including Hawke, a notorious Jewish-born neo-Nazi leader. You’ll follow this 20-year-old’s rise in the trade, where he became a major player in the lucrative penis pill market—a business that would make him a millionaire and the target of lawsuits. You’ll also meet cyber-vigilantes, such as Susan Gunn, who have taken up the fight against spammers like Hawke.Explore the sleazy spammer business practices, the surprising new partnership between spammers and computer hackers, and the rise of a new breed of computer viruses designed to turn the PCs of innocent bystanders into secret spam factories.
Spam Nation: The Inside Story of Organized Cybercrime—from Global Epidemic to Your Front Door
by Brian KrebsA New York Times bestseller and winner of a 2015 Prose Award!There is a threat lurking online. A secret war with the power to destroy your finances, steal your personal data, and endanger your life.In Spam Nation, investigative journalist and cybersecurity expert Brian Krebs unmasks the criminal masterminds driving some of the biggest spam and hacker operations targeting Americans and their bank accounts. Tracing the rise, fall, and alarming resurrection of the digital mafia behind the two largest spam pharmacies—and countless viruses, phishing, and spyware attacks—he delivers the first definitive narrative of the global spam problem and its threat to consumers everywhere.Blending cutting-edge research, investigative reporting, and firsthand interviews, this terrifying true story reveals how we unwittingly invite these digital thieves into our lives every day. From unassuming computer programmers right next door to digital mobsters like "Cosma"—who unleashed a massive malware attack that has stolen thousands of Americans' logins and passwords—Krebs uncovers the shocking lengths to which these people will go to profit from our data and our wallets.Not only are hundreds of thousands of Americans exposing themselves to fraud and dangerously toxic products from rogue online pharmacies, but even those who never open junk messages are at risk. As Krebs notes, spammers can—and do—hack into accounts through these emails, harvest personal information like usernames and passwords, and sell them on the digital black market. The fallout from this global epidemic doesn't just cost consumers and companies billions, it costs lives too.Fast-paced and utterly gripping, Spam Nation ultimately proposes concrete solutions for protecting ourselves online and stemming this tidal wave of cybercrime—before it's too late."Krebs's talent for exposing the weaknesses in online security has earned him respect in the IT business and loathing among cybercriminals… His track record of scoops...has helped him become the rare blogger who supports himself on the strength of his reputation for hard-nosed reporting." —Bloomberg Businessweek
Spam: A Shadow History of the Internet (Infrastructures)
by Finn BruntonWhat spam is, how it works, and how it has shaped online communities and the Internet itself.The vast majority of all email sent every day is spam, a variety of idiosyncratically spelled requests to provide account information, invitations to spend money on dubious products, and pleas to send cash overseas. Most of it is caught by filters before ever reaching an in-box. Where does it come from? As Finn Brunton explains in Spam, it is produced and shaped by many different populations around the world: programmers, con artists, bots and their botmasters, pharmaceutical merchants, marketers, identity thieves, crooked bankers and their victims, cops, lawyers, network security professionals, vigilantes, and hackers. Every time we go online, we participate in the system of spam, with choices, refusals, and purchases the consequences of which we may not understand.This is a book about what spam is, how it works, and what it means. Brunton provides a cultural history that stretches from pranks on early computer networks to the construction of a global criminal infrastructure. The history of spam, Brunton shows us, is a shadow history of the Internet itself, with spam emerging as the mirror image of the online communities it targets. Brunton traces spam through three epochs: the 1970s to 1995, and the early, noncommercial computer networks that became the Internet; 1995 to 2003, with the dot-com boom, the rise of spam's entrepreneurs, and the first efforts at regulating spam; and 2003 to the present, with the war of algorithms—spam versus anti-spam. Spam shows us how technologies, from email to search engines, are transformed by unintended consequences and adaptations, and how online communities develop and invent governance for themselves.
SpamAssassin
by Alan SchwartzSys admins can field scores of complaints and spend months testing software suites that turn out to be too aggressive, too passive, or too complicated to setup only to discover that SpamAssassin (SA), the leading open source spam-fighting tool, is free, flexible, powerful, highly-regarded, and remarkably effective. The drawback? Until now, it was SpamAssassin's lack of published documentation. This clear, concise new guide provides the expertise you need to take back your inbox. "Detailed, accurate and informative--recommended for spam-filtering beginners and experts alike." --Justin Mason, SpamAssassin development team
SpamAssassin: A practical guide to integration and configuration
by Alistair McdonaldWritten specifically for busy network and system administrators, the book is a detailed and practical guide to implementing the right antispam solution for your network and your business requirements. You'll go from a detailed walk through of initial set up, to advanced configuration options like Bayesian filtering, listing, rewriting, and rules. The book shows how to optimize SpamAssassin for all major mail servers and clients. If you are a network or system administrator and you're either using or evaluating SpamAssassin, this book will increase your understanding and transform your productivity.
Spanning Trees and Optimization Problems (Discrete Mathematics and Its Applications)
by Bang Ye Wu Kun-Mao ChaoThe design of approximation algorithms for spanning tree problems has become an exciting and important area of theoretical computer science and also plays a significant role in emerging fields such as biological sequence alignments and evolutionary tree construction. While work in this field remains quite active, the time has come to collect under
Spark Cookbook
by Rishi YadavIf you are a data engineer, an application developer, or a data scientist who would like to leverage the power of Apache Spark to get better insights from big data, then this is the book for you.
Spark Cookbook
by Rishi YadavBy introducing in-memory persistent storage, Apache Spark eliminates the need to store intermediate data in filesystems, thereby increasing processing speed by up to 100 times. This book will focus on how to analyze large and complex sets of data. Starting with installing and configuring Apache Spark with various cluster managers, you will cover setting up development environments. You will then cover various recipes to perform interactive queries using Spark SQL and real-time streaming with various sources such as Twitter Stream and Apache Kafka. You will then focus on machine learning, including supervised learning, unsupervised learning, and recommendation engine algorithms. After mastering graph processing using GraphX, you will cover various recipes for cluster optimization and troubleshooting.
Spark GraphX in Action
by Michael Malak Robin EastSummarySpark GraphX in Action starts out with an overview of Apache Spark and the GraphX graph processing API. This example-based tutorial then teaches you how to configure GraphX and how to use it interactively. Along the way, you'll collect practical techniques for enhancing applications and applying machine learning algorithms to graph data.Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.About the TechnologyGraphX is a powerful graph processing API for the Apache Spark analytics engine that lets you draw insights from large datasets. GraphX gives you unprecedented speed and capacity for running massively parallel and machine learning algorithms.About the BookSpark GraphX in Action begins with the big picture of what graphs can be used for. This example-based tutorial teaches you how to use GraphX interactively. You'll start with a crystal-clear introduction to building big data graphs from regular data, and then explore the problems and possibilities of implementing graph algorithms and architecting graph processing pipelines. Along the way, you'll collect practical techniques for enhancing applications and applying machine learning algorithms to graph data.What's InsideUnderstanding graph technologyUsing the GraphX APIDeveloping algorithms for big graphsMachine learning with graphsGraph visualizationAbout the ReaderReaders should be comfortable writing code. Experience with Apache Spark and Scala is not required.About the AuthorsMichael Malak has worked on Spark applications for Fortune 500 companies since early 2013. Robin East has worked as a consultant to large organizations for over 15 years and is a data scientist at Worldpay.Table of ContentsPART 1 SPARK AND GRAPHSTwo important technologies: Spark and graphsGraphX quick startSome fundamentalsPART 2 CONNECTING VERTICESGraphX BasicsBuilt-in algorithmsOther useful graph algorithmsMachine learningPART 3 OVER THE ARCThe missing algorithmsPerformance and monitoringOther languages and tools
Spark for Data Science
by Srinivas Duvvuri Bikramaditya SinghalAnalyze your data and delve deep into the world of machine learning with the latest Spark version, 2.0 About This Book * Perform data analysis and build predictive models on huge datasets that leverage Apache Spark * Learn to integrate data science algorithms and techniques with the fast and scalable computing features of Spark to address big data challenges * Work through practical examples on real-world problems with sample code snippets Who This Book Is For This book is for anyone who wants to leverage Apache Spark for data science and machine learning. If you are a technologist who wants to expand your knowledge to perform data science operations in Spark, or a data scientist who wants to understand how algorithms are implemented in Spark, or a newbie with minimal development experience who wants to learn about Big Data Analytics, this book is for you! What You Will Learn * Consolidate, clean, and transform your data acquired from various data sources * Perform statistical analysis of data to find hidden insights * Explore graphical techniques to see what your data looks like * Use machine learning techniques to build predictive models * Build scalable data products and solutions * Start programming using the RDD, DataFrame and Dataset APIs * Become an expert by improving your data analytical skills In Detail This is the era of Big Data. The words 'Big Data' implies big innovation and enables a competitive advantage for businesses. Apache Spark was designed to perform Big Data analytics at scale, and so Spark is equipped with the necessary algorithms and supports multiple programming languages. Whether you are a technologist, a data scientist, or a beginner to Big Data analytics, this book will provide you with all the skills necessary to perform statistical data analysis, data visualization, predictive modeling, and build scalable data products or solutions using Python, Scala, and R. With ample case studies and real-world examples, Spark for Data Science will help you ensure the successful execution of your data science projects. Style and approach This book takes a step-by-step approach to statistical analysis and machine learning, and is explained in a conversational and easy-to-follow style. Each topic is explained sequentially with a focus on the fundamentals as well as the advanced concepts of algorithms and techniques. Real-world examples with sample code snippets are also included.
Spark for Data Science Cookbook
by Padma Priya ChitturiThis book is for novice and intermediate level data scientists and data analysts who want to solve data science problems using a distributed computing framework such as Spark. You are expected to have knowledge on statistics, data science tools such as R and Pandas, and an understanding of distributed systems, as well as some exposure to Hadoop.
Spark for Python Developers
by Amit NandiA concise guide to implementing Spark Big Data analytics for Python developers, and building a real-time and insightful trend tracker data intensive app About This Book * Set up real-time streaming and batch data intensive infrastructure using Spark and Python * Deliver insightful visualizations in a web app using Spark (PySpark) * Inject live data using Spark Streaming with real-time events Who This Book Is For This book is for data scientists and software developers with a focus on Python who want to work with the Spark engine, and it will also benefit Enterprise Architects. All you need to have is a good background of Python and an inclination to work with Spark. What You Will Learn * Create a Python development environment powered by Spark (PySpark), Blaze, and Bookeh * Build a real-time trend tracker data intensive app * Visualize the trends and insights gained from data using Bookeh * Generate insights from data using machine learning through Spark MLLIB * Juggle with data using Blaze * Create training data sets and train the Machine Learning models * Test the machine learning models on test datasets * Deploy the machine learning algorithms and models and scale it for real-time events In Detail Looking for a cluster computing system that provides high-level APIs? Apache Spark is your answer--an open source, fast, and general purpose cluster computing system. Spark's multi-stage memory primitives provide performance up to 100 times faster than Hadoop, and it is also well-suited for machine learning algorithms. Are you a Python developer inclined to work with Spark engine? If so, this book will be your companion as you create data-intensive app using Spark as a processing engine, Python visualization libraries, and web frameworks such as Flask. To begin with, you will learn the most effective way to install the Python development environment powered by Spark, Blaze, and Bookeh. You will then find out how to connect with data stores such as MySQL, MongoDB, Cassandra, and Hadoop. You'll expand your skills throughout, getting familiarized with the various data sources (Github, Twitter, Meetup, and Blogs), their data structures, and solutions to effectively tackle complexities. You'll explore datasets using iPython Notebook and will discover how to optimize the data models and pipeline. Finally, you'll get to know how to create training datasets and train the machine learning models. By the end of the book, you will have created a real-time and insightful trend tracker data-intensive app with Spark. Style and approach This is a comprehensive guide packed with easy-to-follow examples that will take your skills to the next level and will get you up and running with Spark.
Spark in Action
by Marko Bonaci Petar ZecevicSummarySpark in Action teaches you the theory and skills you need to effectively handle batch and streaming data using Spark. Fully updated for Spark 2.0.Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.About the TechnologyBig data systems distribute datasets across clusters of machines, making it a challenge to efficiently query, stream, and interpret them. Spark can help. It is a processing system designed specifically for distributed data. It provides easy-to-use interfaces, along with the performance you need for production-quality analytics and machine learning. Spark 2 also adds improved programming APIs, better performance, and countless other upgrades.About the BookSpark in Action teaches you the theory and skills you need to effectively handle batch and streaming data using Spark. You'll get comfortable with the Spark CLI as you work through a few introductory examples. Then, you'll start programming Spark using its core APIs. Along the way, you'll work with structured data using Spark SQL, process near-real-time streaming data, apply machine learning algorithms, and munge graph data using Spark GraphX. For a zero-effort startup, you can download the preconfigured virtual machine ready for you to try the book's code. What's InsideUpdated for Spark 2.0Real-life case studiesSpark DevOps with DockerExamples in Scala, and online in Java and PythonAbout the ReaderWritten for experienced programmers with some background in big data or machine learning. About the AuthorsPetar Zečević and Marko Bonaći are seasoned developers heavily involved in the Spark community.Table of ContentsPART 1 - FIRST STEPSIntroduction to Apache Spark Spark fundamentals Writing Spark applicationsThe Spark API in depth PART 2 - MEET THE SPARK FAMILY Sparkling queries with Spark SQL Ingesting data with Spark Streaming Getting smart with MLlib ML: classification and clustering Connecting the dots with GraphX PART 3 - SPARK OPSRunning Spark Running on a Spark standalone cluster Running on YARN and MesosPART 4 - BRINGING IT TOGETHERCase study: real-time dashboard Deep learning on Spark with H2O
Spark in Action: Covers Apache Spark 3 with Examples in Java, Python, and Scala
by Jean-Georges PerrinSummary The Spark distributed data processing platform provides an easy-to-implement tool for ingesting, streaming, and processing data from any source. In Spark in Action, Second Edition, you&’ll learn to take advantage of Spark&’s core features and incredible processing speed, with applications including real-time computation, delayed evaluation, and machine learning. Spark skills are a hot commodity in enterprises worldwide, and with Spark&’s powerful and flexible Java APIs, you can reap all the benefits without first learning Scala or Hadoop. Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the technology Analyzing enterprise data starts by reading, filtering, and merging files and streams from many sources. The Spark data processing engine handles this varied volume like a champ, delivering speeds 100 times faster than Hadoop systems. Thanks to SQL support, an intuitive interface, and a straightforward multilanguage API, you can use Spark without learning a complex new ecosystem. About the book Spark in Action, Second Edition, teaches you to create end-to-end analytics applications. In this entirely new book, you&’ll learn from interesting Java-based examples, including a complete data pipeline for processing NASA satellite data. And you&’ll discover Java, Python, and Scala code samples hosted on GitHub that you can explore and adapt, plus appendixes that give you a cheat sheet for installing tools and understanding Spark-specific terms. What's inside Writing Spark applications in Java Spark application architecture Ingestion through files, databases, streaming, and Elasticsearch Querying distributed datasets with Spark SQL About the reader This book does not assume previous experience with Spark, Scala, or Hadoop. About the author Jean-Georges Perrin is an experienced data and software architect. He is France&’s first IBM Champion and has been honored for 12 consecutive years. Table of Contents PART 1 - THE THEORY CRIPPLED BY AWESOME EXAMPLES 1 So, what is Spark, anyway? 2 Architecture and flow 3 The majestic role of the dataframe 4 Fundamentally lazy 5 Building a simple app for deployment 6 Deploying your simple app PART 2 - INGESTION 7 Ingestion from files 8 Ingestion from databases 9 Advanced ingestion: finding data sources and building your own 10 Ingestion through structured streaming PART 3 - TRANSFORMING YOUR DATA 11 Working with SQL 12 Transforming your data 13 Transforming entire documents 14 Extending transformations with user-defined functions 15 Aggregating your data PART 4 - GOING FURTHER 16 Cache and checkpoint: Enhancing Spark&’s performances 17 Exporting data and building full data pipelines 18 Exploring deployment