Getting Started with Hazelcast

In the current post we shall see how to getting started with hazelcast, its advanced features before getting in deeper.

In the previous posts we learnt how to install, use Hazelcast and access it using Java.

Ways to start a new Hazelcast Instance.

• Shell Script:

  Shell

  WM-C02RJ2EKG8WP:bin masampat$ cd $HAZELCAST_HOME/bin WM-C02RJ2EKG8WP:bin masampat$ ./start.sh JAVA_HOME found at /Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home Path to Java : /Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home/bin/java ######################################## # RUN_JAVA=/Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home/bin/java # JAVA_OPTS= # starting now.... ######################################## INFO: [192.168.1.104]:5701 [dev] [3.8.3] Members [1] { Member [192.168.1.104]:5701 - b00cb13c-7803-43ff-b1d9-f53a43e8864b this } Jul 18, 2017 8:30:03 PM com.hazelcast.core.LifecycleService INFO: [192.168.1.104]:5701 [dev] [3.8.3] [192.168.1.104]:5701 is STARTED

  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19

  WM-C02RJ2EKG8WP:bin masampat$ cd $HAZELCAST_HOME/bin WM-C02RJ2EKG8WP:bin masampat$ ./start.sh JAVA_HOME found at /Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home Path to Java : /Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home/bin/java ######################################## # RUN_JAVA=/Library/Java/JavaVirtualMachines/jdk1.8.0_74.jdk/Contents/Home/bin/java # JAVA_OPTS= # starting now.... ########################################   INFO: [192.168.1.104]:5701 [dev] [3.8.3]     Members [1] { Member [192.168.1.104]:5701 - b00cb13c-7803-43ff-b1d9-f53a43e8864b this }   Jul 18, 2017 8:30:03 PM com.hazelcast.core.LifecycleService INFO: [192.168.1.104]:5701 [dev] [3.8.3] [192.168.1.104]:5701 is STARTED

• Jar File:

  Shell

  WM-C02RJ2EKG8WP:bin masampat$ cd $HAZELCAST_HOME/lib WM-C02RJ2EKG8WP:lib masampat$ java -cp hazelcast-3.8.3.jar com.hazelcast.console.ConsoleApp Jul 18, 2017 9:02:38 PM com.hazelcast.config.FileSystemXmlConfig INFO: Configuring Hazelcast from '/Users/masampat/next-gen/hazelcast-3.8.3/lib/hazelcast.xml'. Jul 18, 2017 9:02:38 PM com.hazelcast.instance.DefaultAddressPicker INFO: [LOCAL] [dev] [3.8.3] Prefer IPv4 stack is true. Jul 18, 2017 9:02:38 PM com.hazelcast.instance.DefaultAddressPicker INFO: [LOCAL] [dev] [3.8.3] Picked [192.168.1.104]:5702, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5702], bind any local is true Jul 18, 2017 9:02:38 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Hazelcast 3.8.3 (20170704 - 10e1449) starting at [192.168.1.104]:5702 Jul 18, 2017 9:02:38 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved. Jul 18, 2017 9:02:38 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Configured Hazelcast Serialization version : 1 Jul 18, 2017 9:02:38 PM com.hazelcast.spi.impl.operationservice.impl.BackpressureRegulator INFO: [192.168.1.104]:5702 [dev] [3.8.3] Backpressure is disabled Jul 18, 2017 9:02:39 PM com.hazelcast.instance.Node INFO: [192.168.1.104]:5702 [dev] [3.8.3] Creating MulticastJoiner Jul 18, 2017 9:02:39 PM com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl INFO: [192.168.1.104]:5702 [dev] [3.8.3] Starting 8 partition threads Jul 18, 2017 9:02:39 PM com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl INFO: [192.168.1.104]:5702 [dev] [3.8.3] Starting 5 generic threads (1 dedicated for priority tasks) Jul 18, 2017 9:02:39 PM com.hazelcast.core.LifecycleService INFO: [192.168.1.104]:5702 [dev] [3.8.3] [192.168.1.104]:5702 is STARTING Jul 18, 2017 9:02:39 PM com.hazelcast.internal.cluster.impl.MulticastJoiner INFO: [192.168.1.104]:5702 [dev] [3.8.3] Trying to join to discovered node: [192.168.1.104]:5701 Jul 18, 2017 9:02:39 PM com.hazelcast.nio.tcp.InitConnectionTask INFO: [192.168.1.104]:5702 [dev] [3.8.3] Connecting to /192.168.1.104:5701, timeout: 0, bind-any: true Jul 18, 2017 9:02:39 PM com.hazelcast.nio.tcp.TcpIpConnectionManager INFO: [192.168.1.104]:5702 [dev] [3.8.3] Established socket connection between /192.168.1.104:55661 and /192.168.1.104:5701 Jul 18, 2017 9:02:45 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Cluster version set to 3.8 Jul 18, 2017 9:02:45 PM com.hazelcast.internal.cluster.ClusterService INFO: [192.168.1.104]:5702 [dev] [3.8.3] Members [2] { Member [192.168.1.104]:5701 - b00cb13c-7803-43ff-b1d9-f53a43e8864b Member [192.168.1.104]:5702 - 58ead2f8-9a0b-46bf-8b71-d249d629145f this } Jul 18, 2017 9:02:47 PM com.hazelcast.core.LifecycleService INFO: [192.168.1.104]:5702 [dev] [3.8.3] [192.168.1.104]:5702 is STARTED hazelcast[default] >

  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43

  WM-C02RJ2EKG8WP:bin masampat$ cd $HAZELCAST_HOME/lib WM-C02RJ2EKG8WP:lib masampat$ java -cp hazelcast-3.8.3.jar com.hazelcast.console.ConsoleApp Jul 18, 2017 9:02:38 PM com.hazelcast.config.FileSystemXmlConfig INFO: Configuring Hazelcast from '/Users/masampat/next-gen/hazelcast-3.8.3/lib/hazelcast.xml'. Jul 18, 2017 9:02:38 PM com.hazelcast.instance.DefaultAddressPicker INFO: [LOCAL] [dev] [3.8.3] Prefer IPv4 stack is true. Jul 18, 2017 9:02:38 PM com.hazelcast.instance.DefaultAddressPicker INFO: [LOCAL] [dev] [3.8.3] Picked [192.168.1.104]:5702, using socket ServerSocket[addr=/0:0:0:0:0:0:0:0,localport=5702], bind any local is true Jul 18, 2017 9:02:38 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Hazelcast 3.8.3 (20170704 - 10e1449) starting at [192.168.1.104]:5702 Jul 18, 2017 9:02:38 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Copyright (c) 2008-2016, Hazelcast, Inc. All Rights Reserved. Jul 18, 2017 9:02:38 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Configured Hazelcast Serialization version : 1 Jul 18, 2017 9:02:38 PM com.hazelcast.spi.impl.operationservice.impl.BackpressureRegulator INFO: [192.168.1.104]:5702 [dev] [3.8.3] Backpressure is disabled Jul 18, 2017 9:02:39 PM com.hazelcast.instance.Node INFO: [192.168.1.104]:5702 [dev] [3.8.3] Creating MulticastJoiner Jul 18, 2017 9:02:39 PM com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl INFO: [192.168.1.104]:5702 [dev] [3.8.3] Starting 8 partition threads Jul 18, 2017 9:02:39 PM com.hazelcast.spi.impl.operationexecutor.impl.OperationExecutorImpl INFO: [192.168.1.104]:5702 [dev] [3.8.3] Starting 5 generic threads (1 dedicated for priority tasks) Jul 18, 2017 9:02:39 PM com.hazelcast.core.LifecycleService INFO: [192.168.1.104]:5702 [dev] [3.8.3] [192.168.1.104]:5702 is STARTING Jul 18, 2017 9:02:39 PM com.hazelcast.internal.cluster.impl.MulticastJoiner INFO: [192.168.1.104]:5702 [dev] [3.8.3] Trying to join to discovered node: [192.168.1.104]:5701 Jul 18, 2017 9:02:39 PM com.hazelcast.nio.tcp.InitConnectionTask INFO: [192.168.1.104]:5702 [dev] [3.8.3] Connecting to /192.168.1.104:5701, timeout: 0, bind-any: true Jul 18, 2017 9:02:39 PM com.hazelcast.nio.tcp.TcpIpConnectionManager INFO: [192.168.1.104]:5702 [dev] [3.8.3] Established socket connection between /192.168.1.104:55661 and /192.168.1.104:5701 Jul 18, 2017 9:02:45 PM com.hazelcast.system INFO: [192.168.1.104]:5702 [dev] [3.8.3] Cluster version set to 3.8 Jul 18, 2017 9:02:45 PM com.hazelcast.internal.cluster.ClusterService INFO: [192.168.1.104]:5702 [dev] [3.8.3]   Members [2] { Member [192.168.1.104]:5701 - b00cb13c-7803-43ff-b1d9-f53a43e8864b Member [192.168.1.104]:5702 - 58ead2f8-9a0b-46bf-8b71-d249d629145f this }   Jul 18, 2017 9:02:47 PM com.hazelcast.core.LifecycleService INFO: [192.168.1.104]:5702 [dev] [3.8.3] [192.168.1.104]:5702 is STARTED hazelcast[default] >

• Java Program

  Java

  import com.hazelcast.config.Config; import com.hazelcast.core.Hazelcast; import com.hazelcast.core.HazelcastInstance; public class HazelCastServer { public static void main(String[] args) { Config cfg = new Config(); HazelcastInstance instance = Hazelcast.newHazelcastInstance(cfg); } }

  1 2 3 4 5 6 7 8 9 10 11 12

  import com.hazelcast.config.Config; import com.hazelcast.core.Hazelcast; import com.hazelcast.core.HazelcastInstance;   public class HazelCastServer {     public static void main(String[] args) {   Config cfg = new Config(); HazelcastInstance instance = Hazelcast.newHazelcastInstance(cfg);       } }

  When we type “help” in the command line, the following output is displayed, if we have look at it we get a brief idea about the operations supported by Hazelcast.

  Shell

  hazelcast[default] > help Commands: -- General commands echo true|false //turns on/off echo of commands (default false) silent true|false //turns on/off silent of command output (default false) #<number> <command> //repeats <number> time <command>, replace $i in <command> with current iteration (0..<number-1>) &<number> <command> //forks <number> threads to execute <command>, replace $t in <command> with current thread number (0..<number-1> When using #x or &x, is is advised to use silent true as well. When using &x with m.putmany and m.removemany, each thread will get a different share of keys unless a start key index is specified jvm //displays info about the runtime who //displays info about the cluster whoami //displays info about this cluster member ns <string> //switch the namespace for using the distributed queue/map/set/list <string> (defaults to "default" @<file> //executes the given <file> script. Use '//' for comments in the script -- Queue commands q.offer <string> //adds a string object to the queue q.poll //takes an object from the queue q.offermany <number> [<size>] //adds indicated number of string objects to the queue ('obj<i>' or byte[<size>]) q.pollmany <number> //takes indicated number of objects from the queue q.iterator [remove] //iterates the queue, remove if specified q.size //size of the queue q.clear //clears the queue -- Set commands s.add <string> //adds a string object to the set s.remove <string> //removes the string object from the set s.addmany <number> //adds indicated number of string objects to the set ('obj<i>') s.removemany <number> //takes indicated number of objects from the set s.iterator [remove] //iterates the set, removes if specified s.size //size of the set s.clear //clears the set -- Lock commands lock <key> //same as Hazelcast.getLock(key).lock() tryLock <key> //same as Hazelcast.getLock(key).tryLock() tryLock <key> <time> //same as tryLock <key> with timeout in seconds unlock <key> //same as Hazelcast.getLock(key).unlock() -- Map commands m.put <key> <value> //puts an entry to the map m.remove <key> //removes the entry of given key from the map m.get <key> //returns the value of given key from the map m.putmany <number> [<size>] [<index>]//puts indicated number of entries to the map ('key<i>':byte[<size>], <index>+(0..<number>) m.removemany <number> [<index>] //removes indicated number of entries from the map ('key<i>', <index>+(0..<number>) When using &x with m.putmany and m.removemany, each thread will get a different share of keys unless a start key <index> is specified m.keys //iterates the keys of the map m.values //iterates the values of the map m.entries //iterates the entries of the map m.iterator [remove] //iterates the keys of the map, remove if specified m.size //size of the map m.localSize //local size of the map m.clear //clears the map m.destroy //destroys the map m.lock <key> //locks the key m.tryLock <key> //tries to lock the key and returns immediately m.tryLock <key> <time> //tries to lock the key within given seconds m.unlock <key> //unlocks the key m.stats //shows the local stats of the map -- MultiMap commands mm.put <key> <value> //puts an entry to the multimap mm.get <key> //returns the value of given key from the multimap mm.remove <key> //removes the entry of given key from the multimap mm.size //size of the multimap mm.clear //clears the multimap mm.destroy //destroys the multimap mm.iterator [remove] //iterates the keys of the multimap, remove if specified mm.keys //iterates the keys of the multimap mm.values //iterates the values of the multimap mm.entries //iterates the entries of the multimap mm.lock <key> //locks the key mm.tryLock <key> //tries to lock the key and returns immediately mm.tryLock <key> <time> //tries to lock the key within given seconds mm.unlock <key> //unlocks the key mm.stats //shows the local stats of the multimap -- List commands: l.add <string> l.add <index> <string> l.contains <string> l.remove <string> l.remove <index> l.set <index> <string> l.iterator [remove] l.size l.clear -- IAtomicLong commands: a.get a.set <long> a.inc a.dec -- Executor Service commands: execute <echo-input> //executes an echo task on random member executeOnKey <echo-input> <key> //executes an echo task on the member that owns the given key executeOnMember <echo-input> <memberIndex> //executes an echo task on the member with given index executeOnMembers <echo-input> //executes an echo task on all of the members e<threadcount>.simulateLoad <task-count> <delaySeconds> //simulates load on executor with given number of thread (e1..e16) hazelcast[default] >

  1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 73 74 75 76 77 78 79 80 81 82 83 84 85 86 87 88 89 90 91 92 93 94 95 96 97 98 99 100

  hazelcast[default] > help Commands: -- General commands echo true|false                      //turns on/off echo of commands (default false) silent true|false                    //turns on/off silent of command output (default false) #<number> <command>                  //repeats <number> time <command>, replace $i in <command> with current iteration (0..<number-1>) &<number> <command>                  //forks <number> threads to execute <command>, replace $t in <command> with current thread number (0..<number-1>      When using #x or &x, is is advised to use silent true as well.      When using &x with m.putmany and m.removemany, each thread will get a different share of keys unless a start key index is specified jvm                                  //displays info about the runtime who                                  //displays info about the cluster whoami                               //displays info about this cluster member ns <string>                          //switch the namespace for using the distributed queue/map/set/list <string> (defaults to "default" @<file>                              //executes the given <file> script. Use '//' for comments in the script   -- Queue commands q.offer <string>                     //adds a string object to the queue q.poll                               //takes an object from the queue q.offermany <number> [<size>]        //adds indicated number of string objects to the queue ('obj<i>' or byte[<size>]) q.pollmany <number>                  //takes indicated number of objects from the queue q.iterator [remove]                  //iterates the queue, remove if specified q.size                               //size of the queue q.clear                              //clears the queue   -- Set commands s.add <string>                       //adds a string object to the set s.remove <string>                    //removes the string object from the set s.addmany <number>                   //adds indicated number of string objects to the set ('obj<i>') s.removemany <number>                //takes indicated number of objects from the set s.iterator [remove]                  //iterates the set, removes if specified s.size                               //size of the set s.clear                              //clears the set   -- Lock commands lock <key>                           //same as Hazelcast.getLock(key).lock() tryLock <key>                        //same as Hazelcast.getLock(key).tryLock() tryLock <key> <time>                 //same as tryLock <key> with timeout in seconds unlock <key>                         //same as Hazelcast.getLock(key).unlock()   -- Map commands m.put <key> <value>                  //puts an entry to the map m.remove <key>                       //removes the entry of given key from the map m.get <key>                          //returns the value of given key from the map m.putmany <number> [<size>] [<index>]//puts indicated number of entries to the map ('key<i>':byte[<size>], <index>+(0..<number>) m.removemany <number> [<index>]      //removes indicated number of entries from the map ('key<i>', <index>+(0..<number>)      When using &x with m.putmany and m.removemany, each thread will get a different share of keys unless a start key <index> is specified m.keys                               //iterates the keys of the map m.values                             //iterates the values of the map m.entries                            //iterates the entries of the map m.iterator [remove]                  //iterates the keys of the map, remove if specified m.size                               //size of the map m.localSize                          //local size of the map m.clear                              //clears the map m.destroy                            //destroys the map m.lock <key>                         //locks the key m.tryLock <key>                      //tries to lock the key and returns immediately m.tryLock <key> <time>               //tries to lock the key within given seconds m.unlock <key>                       //unlocks the key m.stats                              //shows the local stats of the map   -- MultiMap commands mm.put <key> <value>                  //puts an entry to the multimap mm.get <key>                          //returns the value of given key from the multimap mm.remove <key>                       //removes the entry of given key from the multimap mm.size                               //size of the multimap mm.clear                              //clears the multimap mm.destroy                            //destroys the multimap mm.iterator [remove]                  //iterates the keys of the multimap, remove if specified mm.keys                               //iterates the keys of the multimap mm.values                             //iterates the values of the multimap mm.entries                            //iterates the entries of the multimap mm.lock <key>                         //locks the key mm.tryLock <key>                      //tries to lock the key and returns immediately mm.tryLock <key> <time>               //tries to lock the key within given seconds mm.unlock <key>                       //unlocks the key mm.stats                              //shows the local stats of the multimap   -- List commands: l.add <string> l.add <index> <string> l.contains <string> l.remove <string> l.remove <index> l.set <index> <string> l.iterator [remove] l.size l.clear -- IAtomicLong commands: a.get a.set <long> a.inc a.dec -- Executor Service commands: execute <echo-input>                            //executes an echo task on random member executeOnKey <echo-input> <key>                  //executes an echo task on the member that owns the given key executeOnMember <echo-input> <memberIndex>         //executes an echo task on the member with given index executeOnMembers <echo-input>                      //executes an echo task on all of the members e<threadcount>.simulateLoad <task-count> <delaySeconds>        //simulates load on executor with given number of thread (e1..e16)   hazelcast[default] >

Data structures supported by Hazelcast

Hazelcast is much more powerful than a pure cache. It is an in-memory data grid that supports a number of distributed collections, processors, and features. We can load the data from various sources into differing structures, send messages across the cluster, perform analytical processing on the stored data, take out locks to guard against concurrent activity, and listen to the goings-on inside the workings of the cluster. Most of these implementations correspond to a standard Java collection.

• Standard utility collections:
  • Map: Key-value pairs
  • List: A collection of objects
  • Set: Non-duplicated collection
  • Queue: Offer/poll FIFO collection
• Specialized collection:
  • Multi-Map: Key–collection pairs
• Lock: Cluster wide mutex
• Topic: Publish and subscribe messaging
• Concurrency utilities:
  • AtomicNumber: Cluster-wide atomic counter
  • IdGenerator: Cluster-wide unique identifier generation
  • Semaphore: Concurrency limitation
  • CountdownLatch: Concurrent activity gatekeeping
• Listeners: This notifies the application as things happen
• Distributed Executor Service
• MapReduce Functionality