IBM Redbooks

Mike Ebbers

Peter McCullagh

Renata Ghisloti de Souza

Marcelo Correia Lima

Michael Nobles

Dustin VanStee

Brandon Waters

As world activities become more integrated, the rate of data growth has been increasing exponentially. And as a result of this data explosion, current data management methods can become inadequate. People are using the term big data (sometimes referred to as Big Data) to describe this latest industry trend. IBM® is preparing the next generation of technology to meet these data management challenges. To provide the capability of incorporating big data sources and analytics of these sources, IBM developed a stream-computing product that is based on the open source computing framework Apache Hadoop. Each product in the framework provides unique capabilities to the data management environment, and further enhances the value of your data warehouse investment. In this IBM Redbooks® publication, we describe the need for big data in an organization. We then introduce IBM InfoSphere® BigInsightsTM and explain how it differs from standard Hadoop. BigInsights provides a packaged Hadoop distribution, a greatly simplified installation of Hadoop and corresponding open source tools for application development, data movement, and cluster management. BigInsights also brings more options for data security, and as a component of the IBM big data platform, it provides potential integration points with the other components of the platform. A new chapter has been added to this edition. Chapter 11 describes IBM Platform Symphony®, which is a new scheduling product that works with IBM Insights, bringing low-latency scheduling and multi-tenancy to IBM InfoSphere BigInsights. The book is designed for clients, consultants, and other technical professionals.

Implementing IBM InfoSphere BigInsights on IBM System x

Andreas Wagner

Elsie Ramos

Martin Packer

Snehal Antani

Patrick Bruinsma

Manuel Mueller

Christian Strauer

Sridhar Sudarsan

Susann Thomas

Janet Wall

Mainframe computers play a central role in the daily operations of many of the world's largest corporations, and batch processing is a fundamental part of the workloads that run on the mainframe. A large portion of the workload on IBM® z/OS® systems is processed in batch mode. Although several IBM Redbooks® publications discuss application modernization on the IBM z/OS platform, this book specifically addresses batch processing in detail. Many different technologies are available in a batch environment on z/OS systems. This book demonstrates these technologies and shows how the z/OS system offers a sophisticated environment for batch. In this practical book, we discuss a variety of themes that are of importance for batch workloads on z/OS systems and offer examples that you can try on your own system. The audience for this book includes IT architects and application developers, with a focus on batch processing on the z/OS platform.

Batch Modernization on z/OS

Wonjin Chung

Dody Kurniadi

Joselito Manoto

This IBM® Redbooks® publication will help you to install, tailor, and configure the Open Systems Adapter (OSA) features that are available on IBM zEnterprise® servers. It focuses on the hardware installation and the software definitions that are necessary to provide connectivity to LAN environments. This information will help you with planning and system setup. This book also includes helpful utilities and commands for monitoring and managing the OSA features. This information will be helpful to systems engineers, network administrators, and system programmers who plan for and install OSA features. The reader is expected to have a good understanding of IBM System z® hardware, Hardware Configuration Definition (HCD) or the input/output configuration program (IOCP), Open Systems Adapter Support Facility (OSA/SF), Systems Network Architecture/Advanced Peer-to-Peer Networking (SNA/APPN), and TCP/IP protocol.

OSA-Express Implementation Guide

Micky Reichenberg

Alexandra Winter

This IBM® Redbooks® publication provides information about the IBM System z® HiperSocketsTM function. It offers a broad description of the architecture, functions, and operating systems support. This publication will help you plan and implement HiperSockets. It provides information about the definitions needed to configure HiperSockets for the supported operating systems. This book is intended for system programmers, network planners, and systems engineers who want to plan and install HiperSockets. A solid background in network and Transmission Control Protocol/Internet Protocol (TCP/IP) is assumed.

IBM HiperSockets Implementation Guide

Mike Riches

Gilson Cesar de Oliveira

Rama Ayyar

Octavio L. Ferreira

Yohko Ojima

Maulide Xavier

For more than 40 years, IBM® mainframes have supported an extraordinary portion of the world's computing work, providing centralized corporate databases and mission-critical enterprise-wide applications. The IBM System z®, the latest generation of the IBM distinguished family of mainframe systems, has come a long way from its IBM System/360 heritage. Likewise, its IBM z/OS® operating system is far superior to its predecessors in providing, among many other capabilities, world-class and state-of-the-art support for the TCP/IP Internet protocol suite. TCP/IP is a large and evolving collection of communication protocols managed by the Internet Engineering Task Force (IETF), an open, volunteer organization. Because of its openness, the TCP/IP protocol suite has become the foundation for the set of technologies that form the basis of the Internet. The convergence of IBM mainframe capabilities with Internet technology, connectivity, and standards (particularly TCP/IP) is dramatically changing the face of information technology and driving requirements for even more secure, scalable, and highly available mainframe TCP/IP implementations. The z/OS Communications Server TCP/IP Implementation series provides understandable, step-by-step guidance about how to enable the most commonly used and important functions of z/OS Communications Server TCP/IP. This IBM Redbooks® publication is for people who install and support z/OS Communications Server. It introduces z/OS Communications Server TCP/IP, discusses the system resolver, showing implementation of global and local settings for single and multi-stack environments. It presents implementation scenarios for TCP/IP base functions, connectivity, routing, virtual MAC support, and sysplex subplexing.

IBM z/OS V1R13 Communications Server TCP/IP Implementation: Volume 1 Base Functions, Connectivity, and Routing

Bill White

Gwen Dente

Demerson Cilloti

Sandra Elisa Freitag

Hajime Nagao

Carlos Bento Nonato

Frederick James Rathweg

Thanks to the following people

For more than 40 years, IBM® mainframes have supported an extraordinary portion of the world's computing work, providing centralized corporate databases and mission-critical enterprise-wide applications. The IBM System z®, the latest generation of the IBM distinguished family of mainframe systems, has come a long way from its IBM System/360 heritage. Likewise, its IBM z/OS® operating system is far superior to its predecessors, providing, among many other capabilities, world-class, state-of-the-art, support for the TCP/IP Internet protocol suite. TCP/IP is a large and evolving collection of communication protocols managed by the Internet Engineering Task Force (IETF), an open, volunteer, organization. Because of its openness, the TCP/IP protocol suite has become the foundation for the set of technologies that form the basis of the Internet. The convergence of IBM mainframe capabilities with Internet technology, connectivity, and standards (particularly TCP/IP) is dramatically changing the face of information technology and driving requirements for ever more secure, scalable, and highly available mainframe TCP/IP implementations. The IBM z/OS Communications Server TCP/IP Implementation series provides understandable, step-by-step guidance about how to enable the most commonly used and important functions of z/OS Communications Server TCP/IP. In this IBM Redbooks® publication, we begin with a discussion of Virtual IP Addressing (VIPA), a TCP/IP high-availability approach that was introduced by the z/OS Communications Server. We then show how to use VIPA for high availability, both with and without a dynamic routing protocol. We also discuss a number of different workload balancing approaches that you can use with the z/OS Communications Server. We also explain the optimized Sysplex Distributor intra-sysplex load balancing. This function represents improved multitier application support using optimized local connections together with weight values from extended Workload Manager (WLM) interfaces. Finally, we highlight the most important tuning parameters and suggest parameter values that we observed to maximize performance in many client installations. For more specific information about z/OS Communications Server base functions, standard applications, and security, refer to the other volumes in the series: -- IBM z/OS V1R11 Communications Server TCP/IP Implementation Volume 1: Base Functions, Connectivity, and Routing, SG24-7798 -- IBM z/OS V1R11 Communications Server TCP/IP Implementation Volume 2: Standard Applications, SG24-7799 -- IBM z/OS V1R11 Communications Server TCP/IP Implementation Volume 4: Security and Policy-Based Networking, SG24-7801 For comprehensive descriptions of the individual parameters for setting up and using the functions described in this book, along with step-by-step checklists and supporting examples, refer to the following publications: -- z/OS Communications Server: IP Configuration Guide, SC31-8775 -- z/OS Communications Server: IP Configuration Reference, SC31-8776 -- z/OS Communications Server: IP User's Guide and Commands, SC31-8780 This book does not duplicate the information in those publications. Instead, it complements them with practical implementation scenarios that can be useful in your environment. To determine at what level a specific function was introduced, refer to z/OS Communications Server: New Function Summary, GC31-8771. For complete details, we encourage you to review the documents referred to in "Related publications" on page 303.

IBM z/OS V1R11 Communications Server TCP/IP Implementation Volume 3: High Availability, Scalability, and Performance

For more than 40 years, IBM® mainframes have supported an extraordinary portion of the world's computing work, providing centralized corporate databases and mission-critical enterprise-wide applications. The IBM System z®, the latest generation of the IBM distinguished family of mainframe systems, has come a long way from its IBM System/360 heritage. Likewise, its IBM z/OS® operating system is far superior to its predecessors in providing, among many other capabilities, world-class and state-of-the-art support for the TCP/IP Internet protocol suite. TCP/IP is a large and evolving collection of communication protocols managed by the Internet Engineering Task Force (IETF), an open, volunteer organization. Because of its openness, the TCP/IP protocol suite has become the foundation for the set of technologies that form the basis of the Internet. The convergence of IBM mainframe capabilities with Internet technology, connectivity, and standards (particularly TCP/IP) is dramatically changing the face of information technology and driving requirements for even more secure, scalable, and highly available mainframe TCP/IP implementations. The IBM z/OS Communications Server TCP/IP Implementation series provides understandable, step-by-step guidance about how to enable the most commonly used and important functions of z/OS Communications Server TCP/IP. This IBM Redbooks® publication is for people who install and support z/OS Communications Server. It starts with a discussion of virtual IP addressing (VIPA) for high-availability, with and without a dynamic routing protocol. It describes several workload balancing approaches with the z/OS Communications Server. It also explains optimized Sysplex Distributor intra-sysplex load balancing. This function represents improved application support using optimized local connections together with weight values from extended Workload Manager (WLM) interfaces. Finally, this book highlights important tuning parameters and suggests parameter values to maximize performance in many client installations.

IBM z/OS V1R13 Communications Server TCP/IP Implementation: Volume 3 High Availability, Scalability, and Performance

Gazi Karakus

Yukihiko Miyamoto

Joel Porterie

Andi Wijaya

For more than 40 years, IBM® mainframes have supported an extraordinary portion of the world's computing work, providing centralized corporate databases and mission-critical enterprise-wide applications. The IBM System z®, the latest generation of the IBM distinguished family of mainframe systems, has come a long way from its IBM System/360 heritage. Likewise, its IBM z/OS® operating system is far superior to its predecessors, providing, among many other capabilities, world-class, state-of-the-art, support for the TCP/IP Internet protocol suite. TCP/IP is a large and evolving collection of communication protocols managed by the Internet Engineering Task Force (IETF), an open, volunteer organization. Because of its openness, the TCP/IP protocol suite has become the foundation for the set of technologies that form the basis of the Internet. The convergence of IBM mainframe capabilities with Internet technology, connectivity, and standards (particularly TCP/IP) is dramatically changing the face of information technology and driving requirements for ever more secure, scalable, and highly available mainframe TCP/IP implementations. In this IBM Redbooks® publication, we begin with a discussion of Virtual IP Addressing (VIPA), a TCP/IP high-availability approach that was introduced by the z/OS Communications Server. We then show how to use VIPA for high availability, both with and without a dynamic routing protocol. We also discuss a number of different workload balancing approaches that you can use with the z/OS Communications Server. We also explain the optimized Sysplex Distributor intra-sysplex load balancing. This function represents improved multitier application support using optimized local connections together with weight values from extended Workload Manager (WLM) interfaces. Finally, we highlight the most important tuning parameters and suggest parameter values that we observed to maximize performance in many client installations.

IBM z/OS V1R12 Communications Server TCP/IP Implementation: Volume 3 High Availability, Scalability, and Performance

John Kettner

Wayne O'Brien

Bill Ogden

This IBM® Redbooks® publication provides students of information systems technology with the background knowledge and skills necessary to begin using the basic facilities of a mainframe computer. It is the first in a planned series of book designed to introduce students to mainframe concepts and help prepare them for a career in large systems computing. For optimal learning, students are assumed to have successfully completed an introductory course in computer system concepts, such as computer organization and architecture, operating systems, data management, or data communications. They should also have successfully completed courses in one or more programming languages, and be PC literate. This book can also be used as a prerequisite for courses in advanced topics or for internships and special studies. It is not intended to be a complete text covering all aspects of mainframe operation or a reference book that discusses every feature and option of the mainframe facilities. Others who will benefit from this book include experienced data processing professionals who have worked with non-mainframe platforms, or who are familiar with some aspects of the mainframe but want to become knowledgeable with other facilities and benefits of the mainframe environment.

Introduction to the New Mainframe: z/OS Basics

Wolfgang Fries

Tom Carielli

Peter A. Hoyle

Frank Packheiser

John P. Troy

Quan Yuan

This IBM® Redbooks® publication helps you install, configure, and maintain the IBM zEnterprise 196 server. The z196 offers new functions that require a comprehensive understanding of the available configuration options. This book presents configuration setup scenarios, and discusses implementation examples in detail. This book is intended for systems engineers, hardware planners, and anyone who needs to understand IBM System z® configuration and implementation. Readers should be generally familiar with current IBM System z technology and terminology. For details about the z196 server, see IBM zEnterprise System Technical Introduction, SG24-7832 and IBM zEnterprise System Technical Guide, SG24-7833.

IBM zEnterprise 196 Configuration Setup

Michael Schapira

Dino Tonelli

Jason Arnold

Patric Becker

Yuan-Chi Chang

Willie Favero

Shantan Kethireddy

Nin Lei

Shirley Lin

Ron Lounsbury

Susan Widing Lynch

Cristian Molaro

Deepak Rangarao

As business cycles speed up, many customers gain significant competitive advantage from quicker and more accurate business decision-making by using real data. For many customers, choosing the path to co-locate their transactional and analytical workloads on System z® better leverages their existing investment in hardware, software, and skills. We created a project to address a number of best practice questions on how to manage these newer, analytical type workloads, especially when co-located with traditional transactional workloads. The goal of this IBM® Redbooks® publication is to provide technical guidance and performance trade-offs associated with resource management and potentially DB2® data-sharing in a variety of mixed transactional / data warehouse System z topologies. The term co-location used here and in the rest of the book is specifically defined as the practice of housing both transactional (OLTP) and data warehouse (analytical) workloads within the same System z configuration. We also assumed that key portions of the transactional and data warehouse databases would reside on DB2 for z/OS®. The databases may or may not reside in a DB2 data-sharing environment; we discuss those pros and cons in this book. The intended audience includes DB2 data warehouse architects and practitioners who are facing choices in resource management and system topologies in the data warehouse arena. This specifically includes Business Intelligence (BI) administrators, DB2 database administrators (DBAs) and z/OS performance administrators / systems programmers. In addition, decision makers and architects can utilize this book to assist in making platform and database topology decisions. The book is divided into four parts. Part I, "Introducing the co-location project" covers the System z value proposition and why one should consider System z as the central platform for their data warehousing / business analytics needs. Some topics are risk avoidance via data consolidation, continuous availability, simplified disaster recovery, IBM Smart Analytics Optimizer, reduced network bandwidth requirements, and the unique virtualization and resource management capabilities of System z LPAR, z/VM® and WLM. Part I also provides some of the common System z co-location topologies along with an explanation of the general pros and cons of each. This would be useful input for an architect to understand where a customer is today and where they might consider moving to. Part II, "Project environment" covers the environment, products, workloads, workload drivers, and data models implemented for this study. The environment consisted of a logically partitioned z10TM 32way, running z/VM, Linux®, and z/OS operating system instances. On those instances we ran products such as z/OS DB2 V9, IBM Cognos® Business Intelligence Version 8.4 for Linux on System z, InfoSphereTM Warehouse for System z, InfoSphere Change Data Capture, z/OS WebSphere® V7, Tivoli® Omegamon for DB2 Performance expert. Utilizing these products we created transactional (OLTP), data warehouse query, and data warehouse refresh workloads. All the workloads were based on an existing web-based transactional Bookstore workload, that's currently utilized for internal testing within the System p® and z labs. While some IBM Cognos BI and ISWz product usage and experiences information is covered in this book, we do not go into the depth typically found in IBM Redbooks publications, since there's another book focused specifically on that

Co-locating Transactional and Data Warehouse Workloads on System z

Brian Hatfield

Richard Young

Octavian Lascu

Paola Bari

Marian Gasparovic

Jeff McDonough

Iain Neville

Giancarlo Rodolfi

Thomas Schulze

Paul Sutera

Qi Ye

For the first time it is possible to deploy an integrated hardware platform that brings mainframe and distributed technologies together: a system that can start to replace individual islands of computing and that can work to reduce complexity, improve security, and bring applications closer to the data that they need. With the zEnterprise System a new concept in IT infrastructures is being introduced: zEnterprise ensembles. A zEnterprise ensemble is a collection of highly virtualized diverse systems that can be managed as a single logical entity where diverse workloads can be deployed. Ensembles, together with the virtualization, flexibility, security, and management capabilities provided by the zEnterprise System are key to solving the problems posed by today's IT infrastructure. The zEnterprise System consists of three components: - IBM® zEnterprise Central Processor Complex (CPC) The zEnterprise CPC can either be a zEnterprise 196 (z196) or a zEnterprise 114 (z114). Both zEnterprise CPCs offer z/OS, z/VSE, and z/TPF operating systems, as well as the ability to run many virtualized Linux servers under the z/VM operating system. - IBM zEnterprise BladeCenter Extension (zBX) The zBX provides the capability to run the wide variety of applications typically found in UNIX and x86 architectures. The zBX supports select POWER7 blades running AIX and System x blades running Linux on System x and Microsoft Windows. - IBM zEnterprise Unified Resource Manager Unified Resource Manager runs in the Hardware Management Console (HMC). It provides integrated management across all elements of the zEnterprise System. This IBM Redbooks® publication discusses how to plan and implement an ensemble, using the zEnterprise Unified Resource Manager. This book assumes a knowledge of IT systems, networks, and storage devices.

Building an Ensemble Using IBM zEnterprise Unified Resource Manager

Anthony Fletcher

Mary Lovelace

Andre Coelho

Gert Laumann

Alvaro Salla

Norbert Schlumberger

Each release of IBM® Data Facility Storage Management Subsystem (DFSMS) builds on the previous version. The latest release, IBM z/OS® V1.13 DFSMS, provides enhancements in these areas for the z/OS platform in a system-managed storage environment: Storage management Data access Device support Program management Distributed data access This IBM Redbooks® publication provides a summary of the functions and enhancements in z/OS V1.13 DFSMS. It provides information that you need to understand and evaluate the content of this DFSMS release, along with practical implementation hints and tips. This book also includes enhancements that are available by enabling PTFs that have been integrated into z/OS DFSMS V1.13. This book was written for storage professionals and system programmers who have experience with the components of DFSMS. It provides sufficient information so that you can start prioritizing the implementation of new functions and evaluating their applicability in your DFSMS environment.

z/OS V1.13 DFSMS Technical Update

Stan Washington

Michael Lowe

Gary Wicks

Helene Lyon

Alex Louwe Kooijmans

Today there are new and exciting possibilities available to you for creating a robust IT landscape. Such possibilities include those that can move current IT assets into the twenty-first century, while supporting state-of-the-art new applications. With advancements in software, hardware and networks, old and new applications can be integrated into a seamless IT landscape. Mobile devices are growing at exponential rates and will require access to data across the current and new application suites through new channels. Cloud computing is the new paradigm, featuring anything from SaaS to full server deployment. And although some environments are trying to virtualize and secure themselves, others such as IBM® zEnterprise® have been at the forefront even before cloud computing entered the scene. This IBM RedpaperTM publication discusses how transformation and extensibility can let you keep core business logic in IBM IMSTM and IBM CICS®, and extend BPM, Business Rules and Portal in IBM WebSphere® on IBM z/OS® or Linux on IBM System z® to meet new business requirements. The audience for this paper includes mainframe architects and consultants.

Rethink Your Mainframe Applications: Reasons and Approaches for Extension, Transformation, and Growth

Mike Ebbers

Books

Your next favorite book is out there