Triangle Hadoop Users Group

Slides From Last Night's Talk on Spark and Shark

Wed, 17 Apr 2013 13:28:20 -0400

Slides from last night’s talk on Spark and Shark have been posted.

Also, note, we are now using Meetup for announcing upcoming events in addition to our other channels. See http://www.meetup.com/TriHUG/ for more info.

TriHUG talk on Spark and Shark from trihug

TriHUG February: Real-Time Scalable Data Applications on HBase with Kiji

Mon, 04 Feb 2013 10:47:16 -0500

Build Real-Time Scalable Data Applications on Apache HBase with Kiji

Speaker: Aaron Kimball, WibiData
Date: February 19th, 6:30PM
Location: Bronto Software, Durham, NC

Large-scale data has challenges at every phase in its lifecycle: capture, storage, processing, and result serving. Depending on the nature of the data, and the analysis goals of a data team, imposing the right schema on a NoSQL storage system such as Apache HBase can enable more efficient storage, retrieval, and analysis of relevant information as well as increase the maintainability of such a system moving forward.

In this talk, we present the Kiji framework for building real-time scalable data applications on Apache HBase. Kiji is a collection of Apache2-licensed open source components that extend the Hadoop ecosystem and help developers with schema management, MapReduce processing, and data integration tasks.

To download or learn more about Kiji, visit www.kiji.org.

About the speaker:

Aaron founded WibiData in 2010. He has worked with Hadoop since 2007 and is a committer on the Apache Hadoop project. In addition, Aaron founded the Apache Sqoop data import tool and Apache MRUnit Hadoop testing library projects. Previously he was the first engineer hired by Cloudera, the leading provider of Apache Hadoop-based software and services. Aaron holds a B.S. in Computer Science from Cornell University and a M.S. in Computer Science from the University of Washington. When not thinking about Hadoop, Aaron is an avid sailor, Burning Man devotee, and player of board and video games.

Slides from Cloudera Impala talk on Jan. 29, 2013

Wed, 30 Jan 2013 11:53:44 -0500

Slides from Ricky Saltzer’s talk on Jan. 29 are now posted:

Impala presentation from trihug

TriHUG January: Cloudera Impala

Fri, 18 Jan 2013 08:24:12 -0500

Cloudera Impala: Real-time queries with Apache Hadoop

Speaker: Ricky Saltzer, Cloudera

Date: January 29, 6:30PM

Location: Bronto Software, Durham, NC

Join us for this technical deep dive about Cloudera Impala, the project that makes scalable parallel databse technology available to the Hadoop community for the first time. Impala is an open-sourced code base that allows users to issue low-latency queries to data stored in HDFS and Apache HBase using familiar SQL operators.

RSVP here: http://trihug-01-2013.eventbrite.com/

TriHUG November: Beyond Batch - HBase, Drill and Storm

Thu, 01 Nov 2012 11:36:00 -0400

Brad Anderson of MapR will be taking us “Beyond Batch” with HBase, Drill, and Storm. We’ll also get a look at MapR’s latest release, M7.

Date: November 8th, 6:30PM

Sponsors: Bronto, LucidWorks, MapR, Zaloni

Location: Bronto Software (American Tobacco Campus, Durham NC)

RSVP here: http://trihug-11-2012.eventbrite.com/

TriHUG September: Large Scale Search, Discovery and Analytics in Action

Wed, 12 Sep 2012 11:15:11 -0400

For September, Grant Ingersoll of LucidWorks will be talking about “Large Scale Search, Discovery and Analytics in Action.”

In this talk, you’ll learn how a platform enables large scale search, discovery and analytics over a wide variety of content, utilizing tools like Solr, Hadoop, Mahout and others.

Date: September 18th, 6:30PM
Location: Bronto Software (American Tobacco Campus, Durham NC)

RSVP here: http://trihug-09-2012.eventbrite.com/

TriHUG August: Intro to Hive

Tue, 07 Aug 2012 10:25:40 -0400

After a summer break, TriHUG is back with a lineup of great speakers this fall, starting on Tuesday, August 14th, with Ricky Saltzer from Cloudera!

Ricky will be talking about Hive, a data warehouse system for Hadoop that uses a SQL like interface for ad-hoc querying.

RSVP here: http://trihug-08-2012.eventbrite.com/

Topic: Intro to Hive

Speaker: Ricky Saltzer, Cloudera

Date: August 14th, 6:30PM

Location: Bronto Software, Durham, NC

Slides from May 22nd talk by David Arthur

Thu, 24 May 2012 12:41:00 -0400

Thanks to David Arthur of Lucid Imagination for his presentation on Apache ZooKeeper!

Intro to Apache Zookeeper

Mon, 21 May 2012 08:41:00 -0400

ZooKeeper - An Introduction and Practical Use Cases”

Speaker: David Arthur, Lucid Imagination

Date: May 22nd, 6:30PM

Location: Bronto Software, Durham, NC

RSVP: http://trihug-05-2012.eventbrite.com/

Abstract: ZooKeeper is a distributed coordination service with a strong emphasis on update consistency. It can be used for simple things like configuration management and distributed id assignment, as well as more complex things like distributed locking and service discovery. The API provided by ZooKeeper is rather low-level and requires a bit of boilerplate code, so we will also look at some higher level frameworks.

David Arthur is a software engineer at Lucid Imagination working on the new “Big Data” team. He has been working for the last two years building distributed systems where Hadoop has been a central component. Prior to working in the “big data” space, he focused mainly on data side of applications: schema optimization, data warehousing, etc. He attended Florida State University where he received a B.S. in Physics and completed two years of graduate studies in Scientific Computing.

Next Meeting: IBM Watson on April 12, 2012 @ Bronto Software

Wed, 04 Apr 2012 15:38:24 -0400

Title: IBM Watson: Big Data Text Analytics

Location: Bronto Software in Durham, NC

Speaker: John Gerken

RSVP: http://trihug-04-2012.eventbrite.com/

Abstract: What is IBM Watson? It managed to defeat two previously undefeated human opponents in a game show and it has shown how super computers are becoming more and more able to understand and answer questions in ways previously reserved for the domain of human thought. But what most don’t realize is how the synergy between Big Data and text analytics was integral to enabling IBM Watson’s capabilities. Curious as to how Watson leveraged Big Data and text analytics technologies? Wondering what the future may hold for applying them? If so, attend TriHUG on April 12 to find out.

Speaker Bio: John Gerken is a Senior Software Architect in IBM’s Emerging Technologies jStart Team, where he is responsible for recognizing, promoting and developing prototypes of software technologies and trends that could positively impact IBM’s customers. John is an IBM Watson Team Leader working to enable Watson to be used by customers. He is also a recognized thought leader in the area of Situational Applications and mashup ecosystems and is a principle evangelist for these technologies. John is a member of the North Carolina Technical Experts Council (NC TEC), which is an IBM Academy affiliated technical advisory and vitality organization serving the RTP, NC area. He also holds a Bachelors of Science in Jazz Performance and plays at every opportunity.

Sponsors: Bronto Software, Lucid Imagination

Slides from March 20 talk by Jameson Lopp

Fri, 23 Mar 2012 11:50:23 -0400

Thanks to Jameson Lopp of Bronto Software for his presentation on Pratical Pig. Here are the slides:

Pratical Pig

View more presentations from trihug.

Slides from Feb 16. talk by Adam Gugliciello of Datameer

Wed, 22 Feb 2012 19:55:28 -0500

Thanks to Adam Gugliciello of Datameer for the talk at TriHUG last week! Here are the slides:

Financial services trihug

View more presentations from trihug.

Next Meeting: Feb. 16 @ Bronto Software

Wed, 01 Feb 2012 08:37:00 -0500

Title: Financial Data Analytics with Hadoop

Sponsored By:

RSVP here

Abstract:

Hadoop based applications are becoming critical in the financial services arena for the analysis and correlation of large volumes of structured and unstructured data. In addition, the Dodd-Frank Act signifies the largest US financial regulatory change in several decades and requires much greater transparency on financial data. In this session, we will answer common questions and demonstrate use cases in how Hadoop and Datameer help with asset management and risk management, fraud detection and data security.

Leave this session knowing about:

Financial data and Hadoop. What data lends itself to Hadoop? What doesn’t?
Benchmarks from real-world uses of Hadoop in finance
How to effectively migrate, manage, and analyze financial data using Hadoop

Bio: Adam Gugliciello, a 15-year veteran in Software Engineering and Systems Architecture specializes in highly available, parallel systems. Most recently he has been developing grid computing solutions to enable deep analyses and intelligence gathering on huge software systems for technical debt and functional mapping. Adam is a Solution Engineer at Datameer and helps bring Financial and Telco applications expertise to the utilization of the Datameer business intelligence suite.

Slides from Intro to HBase presentation January 2012

Wed, 18 Jan 2012 14:04:00 -0500

Thanks to Chris Shain from Tresata for coming to Durham last night to talk about HBase.

TriHUG January 2012 Talk by Chris Shain

Next Meeting: January 17, 2012 @ Bronto Software

Sun, 08 Jan 2012 16:54:00 -0500

Title: Intro to Apache HBase by Chris Shain of Tresata

Location: Bronto Software in Durham, NC

RSVP

Abstract: Chris will provide an introduction to Apache HBase, aiming to discuss:

What is HBase? (High level overview)
Details of the HBase architecture
How do clients interact with HBase?
Some general HBase patterns and anti-patterns
What are the use cases for HBase vs. Relational DB?

Bio: Chris Shain is the software development lead at Tresata, a provider of Big Data solutions for the financial industry in Charlotte NC. His background includes 7+ years of software development experience in the financial services industry, with a focus on customer-facing data management applications and data warehousing. Lately he works with Hadoop and HBase on data volumes in the multi-terabyte range, and tinkers with geographic information systems. He lives in Charlotte NC, and can be reached at chris@tresata.com or twitter @ChrisShain.

Slides from Alan Gates Presentation on Nov. 15, 2011

Fri, 18 Nov 2011 15:20:38 -0500

Thanks to Alan Gates of Hortonworks for the two excellent presentations on Apache Pig and Apache HCatalog. Links to the slides for the two talks are included below and are also available on Slideshare.

TriHUG November Pig Talk by Alan Gates

View more presentations from trihug.

TriHUG November HCatalog Talk by Alan Gates

View more presentations from trihug.

Slides from Oct. 11 TriHUG meeting featuring Josh Patterson of Cloudera

Wed, 12 Oct 2011 15:53:37 -0400

OSCON Data 2011 - Lumberyard View more presentations from Josh Patterson

Next Meeting: November 15, 2011 @ Bronto Software

Wed, 12 Oct 2011 08:18:00 -0400

Our next meeting will be November 15 at Bronto Software. The speaker will be Alan Gates, the author of Programming Pig and a member of the Hortonworks team. RSVP here.

————-

Title: New Features in Pig 0.9 and Introducing HCatalog

Abstract: Pig 0.9 added several features to make Pig a more powerful data processing platform, including macros, include statements, and the ability to embed Pig in Python for control flow. We’ll cover these, talk about some new features that have been added since 0.9, and what’s next on Pig’s roadmap.

HCatalog is a table management and storage management layer for Hadoop that enables users with different data processing tools – Pig, MapReduce, Hive, Streaming – to more easily read and write data on the grid. HCatalog’s table abstraction presents users with a relational view of data in the Hadoop distributed file system (HDFS) and ensures that users need not worry about where or in what format their data is stored – RCFile format, text files, sequence files. This talk will include an overview of HCatalog’s features and a discussion of its current roadmap.

Bio: Alan is a co-founder of Hortonworks as well as an original member of the engineering team that took Pig from a Yahoo! Labs research project to a successful Apache open source project. Alan also designed HCatalog and guided its adoption as an Apache Incubator project. Alan has a BS in Mathematics from Oregon State University and a MA in Theology from Fuller Theological Seminary. He is also the author of Programming Pig, a forthcoming book from O’Reilly Press. Follow Alan on Twitter: @alanfgates.

TriHUG Next Meeting featuring Josh Patterson of Cloudera set for Oct. 11

Wed, 14 Sep 2011 08:26:45 -0400

The next Triangle Hadoop User Group meeting will be October 11th at Bronto Software and will be featuring Josh Patterson of Cloudera. RSVP here.

Title: Lumberyard: Time series Indexing at Scale

Abstract:

As time series data explodes in volume in the genomic, sensor, and

financial realms [1] companies are looking for more effective ways to

store and query this data. To handle this explosion in scale systems

are looking to the Hadoop, HBase, and NoSQL domain for components to

build their systems on. In this talk we introduce Lumberyard [3], a

system which can potentially (1) store Terabytes of time series data

and allow for this data to be interactively queried at low latencies

to provide real time access. Lumberyard stores iSAX [4] indexes in

HBase’s Multi-dimensional sorted map storage system which give

Lumberyard the reliability of HDFS yet the low latencies of HBase. Our

approach leverages a multidimensional indexing structure which is

stored in HBase’s highly available distributed multi-dimensional

sorted map. We present the design of Lumberyard’s implementation and

illustrate the differences between an in-memory iSAX index compared

with a persisted HBase-backed iSAX index.

Sponsored by Cloudera and Bronto Software.

More info at www.trihug.org.

Bio:

Master’s Thesis: self-organizing mesh networks Published in IAAI-09:

TinyTermite: A Secure Routing Algorithm

Conceived, built, and led Hadoop integration for the openPDC project

at TVA (Smartgrid stuff). Led small team which designed classification

techniques for timeseries and Map Reduce. Open source work at

http://openpdc.codeplex.com

Now: Sr. Solutions Architect at Cloudera

Slides from Ted Dunning's Sept. 2011 talk

Wed, 14 Sep 2011 07:15:48 -0400

Thanks to everyone for attending last night’s talk! Ted’s slides are available for download below.

MapR, Implications for Integration View more presentations from trihug