Category Archives: data grid

Data Grid

Coherence Incubator 10 Patch 2 Released

Just uploaded the latest fix patches for Coherence Incubator 10.  While mostly minor fixes, there’s also a few new additions, like the new @LiveObject annotation.  Check out the Coherence Incubator project pages for more details.  http://coherence.oracle.com/display/INC10

London Coherence Training Schedule

If you’re in London and looking for Coherence training, you’re in luck.  Oracle University is now offering regular training.  While based on Coherence 3.6 at the moment, it’s a great introduction to Coherence.  Moving to Coherence 3.7 will be a snap.

Coherence SIG: Spring Edition: 3rd May, 2011

Updated: The registration is now open here:  http://www.ukoug.org/events/ukoug-coherence-sig/

LONDON COHERENCE SPRING “ROYAL WEDDING” SIG

3rd May, 2011
Oracle London
One South Place,
London. EC2M 2RB (Google Map)

SCHEDULE

The theme of this SIG is to discuss and cover in some detail, the latest (to be released very very shortly unless there’s some kind of disaster), version of Coherence.  Essentially the morning will cover Coherence, the afternoon will cover Incubator examples (also being released simultaneously).

For this SIG we’re only running a single track, simply to focus on the latest release.  For the next SIG we’ll be running multiple tracks again.

10:00 Registration

Registration, Badge and Schedule Pick Up.  Tea, Coffee and refreshments served.

KNIGHTSBRIDGE

10:30  Coherence 3.7 Update: Part 1 (Brian Oliver and friends, Oracle)
In this talk we’ll take a look at some of the latest features in Coherence 3.6+.  More details to come once it’s released.

11:45  Coherence 3.7 Update: Part 2 (Brian Oliver and friends, Oracle)
The follow on session from Part 1 :)

13:00  Lunch

13:30  Evolution of Gridman (Andrew Wilson)
In this talk, Andrew will walk through the architectural progression from “put-get” man right through to real-time-scalable-events man. It took him 4 years to make this transition and he’s still learning!

14:45  Incubator 10 Goodies: Testing and Tooling (Brian Oliver, Harvey Raja, Oracle)
Finally it’s here and there’s a lot of new goodies.  This talk will focus on Testing and the latest things in Coherence Common, including reflection-based POF serialization

15:45  Break

16:15  The Event Distribution Pattern (Brian Oliver, Oracle)
In this talk we take a look at the newest edition to the Incubator, the Event Distribution Pattern, a simple pattern enabling the distribution of application level events to multiple devices and/or clusters.  Now the basis of latest Push Replication Pattern, the Event Distribution Pattern opens up an entirely new range of new architectural styles for your applications.

17:00 (to be announced)

17:45 Close

Announcement: Next London Coherence SIG: 3rd May 2011

It’s that time again, time for another London Coherence SIG.

Although the agenda is yet to be finalized, the theme of the event will be the up-and-coming Coherence 3.7 and Incubator 10 releases.  So lock in the date, Tuesday May 3rd, 2011 at the London Oracle Offices.

The complete agenda and registration page will announced soon!

London Coherence SIG: Winter Edition: 27th of January, 2011

Happy New Year!
I hope you had a fantastic 2010 and 2011 is even better.

For 2010 the Coherence SIGs were a huge success, expanding into even more cities around the world, bringing in a large variety of speakers and expanding the content covered. In London we moved to the full day format which has proven to be really successful.  The great thing is that 2011 is going to be even better, promising more cities, even more content and especially, the release of Coherence 3.7 (at some point).

To kick things off for London in 2011, the next London Coherence SIG, scheduled for the 27th of January 2011, will run all day and with two parallel tracks.  That is, we’re going to double the number of seats available, double the content and double the number of speakers.

Registration for the SIG is now available online at the UKOUG site here:
http://www.ukoug.org/calendar/show_event.jsp?id=5563

NOTE: You’ll have to choose which of the tracks you’d like to attend during registration.  But don’t worry you can change on the day.

Look forward to seeing you soon!

LONDON Coherence WINTER SIG

27th January, 2011
Oracle London
One South Place,
London. EC2M 2RB (Google Map)

SCHedule

10:00 Registration

Registration, Badge and Schedule Pick Up.  Tea, Coffee and refreshments served.

Knightsbridge Track

10:30  Coherence Update (Brian Oliver, Oracle)
In this talk we’ll take a look at some of the latest features in Coherence 3.6, briefly discussion Coherence 3.7 and what’s new in the latest Coherence Incubator Release, including annotation driven serialization.

11:45  Inside the Coherence Management Framework (Everett Williams, sl.com)
As the lead engineer and contributor to the Coherence Management Framework, Everett (now working at sl.com) will present an inside view of the Coherence Management Framework, how it works, is put together, things you may not know about and how to use the JMX Reporter.

13:00  Lunch

13:30  Testing Coherence-based Applications (Andrew Wilson)
Testing distributed applications, especially those that use Coherence, typically requires a little more effort than a  single threaded/single process application.  In this talk Andrew will discuss and demonstrate a number of tips and tricks covering unit, integration and performance testing that will make your life easier when testing Coherence-based applications.

14:45  Coherence Performance Under The Microscope (Tom Lubinski, CTO, sl.com)
Using the Coherence API is relatively easy, but how your calls onto the API are measured and reported is something different all together.  In this technical talk Tom outlines the underlying schematics of messages, requests and tasks, things that you commonly seen in JMX.  He discussed what are they, why should you care and which ones are important, especially in a production system. Tom Lubinksi then explains how these metrics relate to the workings of the distributed cache service, the invocation service and entry processors.  He will show you how to plot these metrics  to literally “ see” how Coherence is executing your code and using system resources. These insights can then help you tune and troubleshoot your data grid.

Tom founded SL Corporation in 1983 and currently serves as the company’s Founder and CTO. He has been instrumental in developing RTView, a real-time monitoring, analytics and visualization platform, as well as RTView Oracle Coherence Monitor and Viewer for the monitoring and management of Oracle Coherence data grids. Since founding the company, he has been involved in thousands of successful customer deployments of real-time visibility solutions. He has an immensely deep understanding of monitoring and managing distributed systems.  He’s an entertaining and talented speaker with a passion for technology.  Not a talk to be missed.

15:45  Break

16:15  Where does it run? (Andrew Wilson and friends)
In this talk Andrew (and friends) walk through the numerous APIs, extensions and plug-ins available to developers in Coherence, what they are, how they work and importantly where they are executed, knowledge that’s crucial to know if you want to take full advantage of your investment and save yourself some time.

Guaranteed to be an entertaining talk about there experiences in learning the Coherence API, including what they learnt, mistakes they made and their recommendations for each feature.

17:00  Java Platform Update (Sten Garmark, Oracle)
While not specifically focused on Coherence, in this talk we discuss the road ahead for the Java Platform, including the up-and-coming Java 7 and 8 platforms.

If you’re interested in what’s coming in Java and would like an opportunity to interact directly with Oracle Java Product Management, this will be a great talk.

17:45 Close

Waterloo Track

10:30  Beyond Caching and Data Grids:  Lessons in using Coherence as a System of Record  (Ben Stopford)
For most Coherence Architects, denormalising an object model to scale out data access and parallelize queries is a bread and butter activity. However when attempting to use Coherence as a system of record, especially in much the same way as one would use a traditional database, so that things like versioning and joins are easily permitted, normalizing the object model is what you really need.  Unfortunately having a completely normalized relational model will often lead to some serious scalability and or performance challenges.  Likewise having a completely denormalized model will often lead to large amounts of communication to perform things like joins.

In this technical talk Ben outlines the use of Star Schemas and how the adoption of data-ware housing approaches with Coherence provides a mechanism to represent and manage cached data in a normalization manner so that joins (and versioning of data) are possible without sacrificing too much performance and maintaining linear scalability.

11:45  The Live Object Pattern (Brian Oliver, Oracle)
In this talk we’ll introduce the concept of the “Live Object Pattern” and how Live Objects may be used to model configuration, scheduled jobs and points of integration with non-Coherence resources.

The Live Object pattern is fundamental to other pattern implementations, like the Command, Messaging and Push Replication.

13:00  Lunch

13:30  How To Build a Coherence Practice (Craig Blitz)
In this talk Craig discusses what happens after you’ve chosen and started to adopt Coherence.  ie: when the hard work begins.   The talk will help you get the most out of your investment both from a project and enterprise perspective by introducing you to the resources available from Oracle and through the Coherence ecosystem. He’ll discuss best organizational practices we’ve seen and how you can implement them to ensure success with Coherence. Drawing on significant experience with customers’ Coherence deployment, Craig will show what works and what doesn’t in practice.

14:45 Integrating Coherence and OSGi (David Whitmarsh)
In this technical talk David discusses the steps to integrate Coherence with OSGi.  David outlines the challenges, how to’s, traps and benefits of adopting a modular architecture with Coherence.

If you’re interested in adopting Coherence in an OSGi container, or even building a modular application with Spring, this is a great introductory talk.

15:45  Break

16:15  Cool Coherence Features (Harvey Raja, Oracle)
In this technical talk Harvey walks through some of the new features in Coherence 3.6, including Quorums and Default Serializers.  Additionally Harvey presents the new CohClipse plug-in for Eclipse, a tool to help generation serializers for Coherence.

17:00 Developing Custom Push Replication Providers (Brian Oliver, Oracle, with Solace Systems)
In this technical talk we discuss the development and configuration of custom Push Replication Providers, including the new JMS Push Replication Provider, that allows Coherence to use standard JMS providers as a means to manage replication state.

As a demonstration we’ll show how to configure Push Replication to use a Solace Messaging Appliance as replication infrastructure.

17:45 Close

London Coherence SIG: Autumn Edition: 1st of October, 2010

Just a quick update about the next London Coherence SIG.  We’ve scheduled it for the 1st of October.  It will be held in the London Oracle Offices and like the last event, will run all day.  The morning will be dedicated to workshops with talks in the afternoon.

Registration page for the event is here.

See you there.

– Brian

Coherence 3.6 Released

Today Oracle announced and made generally available Coherence 3.6.  Like it’s predecessor Coherence 3.5, there’s a lot of stuff in Coherence 3.6, parts of which may be considered entirely new products in the Data Grid space.  Having been through four beta releases over the past six months, it’s ready for prime time.  You can download it now via the Coherence site http://coherence.oracle.com.

While the release notes are extensive as usual, here’s a few of the cool new features.

1. The new Transaction Framework

This is something we’ve been working on for sometime and deprecates the old TransactionMap implementation.  What do you get?  Well the new Transaction Framework is based on an entirely new Multi-Version-Concurrency-Control implementation that is designed to provide ACID transaction guarantees across caches (and partitions). Better still, it supports NamedCache features like queries, aggregation, and entry processors, across caches, all within the context of a transaction.  That’s right.  You can now do fully distributed server-side grid-based processing across caches transactionally.  Further, like the rest of Coherence, you can do this while servers are being added and removed from the cluster.

2. The new Coherence Query Language

Also something we’ve been working on for sometime, the new Coherence Query Language (CohQL) is designed as light-weight SQL and JPA-like query language for querying caches.  There are two main components to the new CohQL feature;

i). a query builder that can compile SQL-like queries into regular Coherence Filters, thus meaning you can use CohQL in existing MapListeners, Queries, Entry Processors, Aggregators etc ,and

ii). a new console tool that can be used to query, backup, restore and manage a cluster.

There are numerous examples here.

3. The new Quorum facility for Services

In Coherence 3.6 we’ve introduced the concept of Quorums that allow you to specify the behaviour of individual Services (like the Proxy, Cache and Cluster services etc) during cluster membership changes.  That is, Quorums allow you to specify the minimum number of service members that are required before actions on the said service is allowed (or disallowed).

For example:  Say you want to restrict remote clients from connecting to a cluster until a certain number of proxy services (say 3) are available.  All you need to do is specify the proxy-quorum-policy-scheme.

<caching-schemes>
<proxy-scheme>
<scheme-name>proxy-with-quorum</scheme-name>
<service-name>TcpProxyService</service-name>
<acceptor-config>
<tcp-acceptor>
<local-address>
<address>localhost</address>
<port>32000</port>
</local-address>
</tcp-acceptor>
</acceptor-config>
<autostart>true</autostart>
<proxy-quorum-policy-scheme>
<connect-quorum>3</connect-quorum>
</proxy-quorum-policy-scheme>
</proxy-scheme>

Of course like the rest of Coherence you can also specify and use custom policies.  These could do anything you like, from restricting read access based on some business condition or ensuring the cluster doesn’t start to balance partitions until a certain number of members have started – thus making large-cluster start ups almost instant.

4. The new .NET Session Manager

In this release we’ve brought the Coherence .NET Session Manager implementation to be in parity with the Java Enterprise Edition (Coherence *Web) Session Managers.  I think I can confidently state there is no other implementation like this for .NET available on the market.

As stated, these are just a few of the new features.  There are significantly more goodies in the release notes.  Stay tuned for individual postings on what’s new and examples.

Bay Area Coherence SIG: 15th July, 2010

The next Bay Area Coherence SIG will be held on the 15th of July, 2010 at the Oracle Redwood Shores Office.  Details of the agenda and registration process are here:

http://coherence.oracle.com/display/CSIG/15+Jul+2010+-+Redwood+Shores,+CA

Like at the Toronto Coherence SIG, Coherence 3.6 will be presented.  This is one of the first official public presentations about Coherence 3.6!

So if you’re in San Francisco/Bay Area and/or have colleagues in around there, get them along to the *free* SIG to hear about the latest features

Toronto Coherence SIG: 23rd July 2010

The next Toronto Coherence SIG will be held on the 23rd of July, 2010 at the Oracle Mississauga Office.  Details of the agenda and registration process are here:

http://coherence.oracle.com/display/CSIG/23+Jul+2010+-+Mississauga%2C+ON

One interesting thing to note: Coherence 3.6 will be presented.  This is one of the first public presentations about Coherence 3.6!

So if you’re in Toronto and/or have colleagues in Toronto, get them along to the *free* breakfast SIG to hear about the latest features.

BTW: Stay tuned for the next London Coherence SIG announcements, including a half day workshop dedicated to Coherence 3.6.

London Coherence SIG: Spring Edition: 10th June 2010 (registration now open)

The registration for the next London Coherence SIG, occurring on the 10th of June, is now open.  However before you rush to register, there are several important things to note.

1. This event unlike previous London Coherence SIGs is being run over an entire day! That’s right.  An entire day! We have so much content and so many requests for talks that we’re expanding the London Coherence SIG.  As a trial we’re organizing the day as follows;

In the morning we’re running several workshop sessions.  These will focus on core concepts and some advanced use-cases. They are designed to be informal with plenty of opportunities to ask questions, provide feedback etc.

In the afternoon we’re running the usual presentation sessions, much like the regular Coherence SIGs that we’ve been running for the past few years.

Given this new format the SIG registration process has changed a little.  Like before you still register for the entire Coherence SIG with the UKOUG, but as part of the last stage of the process you must now nominate which of these sessions you’d like to attend (or both if you like).

The registration page, hosted by the UKOUG is here.

As before, the event is free for all to attend, but please remember if you register but then can’t attend, please let us know as we do incur costs for non-attendance.  ie: catering is not free for us.

2. Given the growth of the Coherence SIGs, us constantly running out of space and having waiting lists, we’re changing to a larger premises.  This event will be held at the Sun Microsystems Office, not the usual Oracle Office.  Here’s the new address.

Sun Microsystems: Customer Briefing Centre
Regis House
45 King William Street
EC4R 9AN

Here’s the Google Map.

3. We have some great talent talking at this SIG.  While I’m sure all of the workshops and presentations will be helpful, I’d especially like to point out that we’ve got Gene Gleyzer (Chief Architect of Coherence) and Patrick Peralta (Senior Engineer and Production Guru) coming over from the Boston-based Coherence Engineering group to present.  These are talks you shouldn’t miss.

Ok… here’s what you’ve been waiting for.  The final agenda.

Workshop Sessions

10:30 Workshop Registration and Welcome

11:00 Workshop: Coherence Cache Configuration and Deployment Patterns (Brian Oliver, Oracle)

In this workshop we discuss the various common Coherence Cache Configurations and how they relate to deployment patterns.  We’ll cover all of the common cache configurations and deployment topologies.  If you’re just starting with Coherence, this talk will be invaluable to help you build your deployment model.

11:45 Workshop: Coherence Monitoring & Management with Geneos (Nick Pike, ITRS)

ITRS Geneos is an enterprise standard for real-time infrastructure and application monitoring in three of the top five investment banks. It is a proactive, real-time systems management tool used to provide a unified view of production systems from an IT and business perspective.

In this workshop Nick outlines how Geneos has been used by a number of customers to monitor and manage both Coherence infrastructure and applications built on Coherence. During the workshop a demonstration will highlight how managing Coherence is simplified from an operations perspective and how the tool may also be used to simplify application development, including automated housekeeping like memory management and rolling restarts.

12:30 Workshop Lunch

Please Note:  The workshop lunch is only provided to delegates that attend the morning sessions.

13:00 Workshop: Understanding Rolling Restarts and Upgrades (David Felcey, Oracle)

Providing 24×7 uptime for a Coherence Data Grid requires planning. This workshop will discuss and demonstrate how database tables, cached data objects and clients can be upgraded in a running data grid with no downtime. It will also address operational issues and outline some of the limitations of performing rolling upgrades.

14:00 SIG Registration and Welcome

14:30  Presentation: More Coherence War Stories (Patrick Peralta, Oracle)

In this talk Patrick outlines some of the more interesting Coherence battle stories and the challenges sometimes faced in real production environments with real customers (who lived happily ever after.)  Patrick then discusses operational best practices to avoid such issues and what to do if (when?) they arise.

15:15  Presentation: Coherence 3.5 Advanced Topics (Dr Gene Gleyzer, Oracle)

In this talk Gene discusses some of the more advanced features of Coherence 3.5, including the Service Guardian, Partitioned Backing Maps.  If you’ve ever wanted to know more about how Coherence works, especially the advanced features, this talk by one of the founders of Tangosol and the Chief Architect of Coherence shouldn’t be missed.

16:00  Break

16:30  Presentation: Developing Scalable Queried with Coherence (Patrick Peralta, Oracle)

In addition to the Map based API, Coherence provides a rich API to allow for parallel querying of objects using arbitrary criteria. This talk will explore various techniques for creating efficient and scalable queries with Coherence. Although the query API is simple from a developer point of view, writing queries that yield scalable performance requires upfront design. We will consider query patterns (and anti-patterns) and explore the tools Coherence provides to develop efficient and linearly scalable queries.

17:15  Presentation: Introduction to Push Replication 3.0 (Brian Oliver, Oracle)

In this talk we’ll outline the next generation of Push Replication.  We’ll cover how to use declarative configuration, instead of programmatic configuration, and how to replace the internals, like replacing Coherence Messaging with JMS.

18:00 Close

Looking forward to catching up with everyone and hearing the feedback for this event.

Cheers

Brian