2013-04-09 69 views
2

我正在处理一个需要将数据插入到Cassandra数据库的项目。因此,我正在使用Pelops clientjava.lang.RuntimeException:注册MBean时发生异常com.scale7.cassandra.pelops.pool:type = PooledNode-my_keyspace-localhost

我有一个多线程代码,它将使用Pelops client插入Cassandra数据库。我正在使用ExecutorService

在我的程序,每个线程都工作在一定范围内,比如

Thread1 will work on 1 to 20 
Thread2 will work on 21 to 40 
... 
... 

下面是代码我有我使用插入到Cassandra的数据库 -

private static int noOfThreads = 5; 
private static int noOfTasks = 100; 
private static int startRange = 1; 

    public static void main(String[] args) { 

     LOG.info("Loading data in Cassandra database..!!"); 

     ExecutorService service = Executors.newFixedThreadPool(noOfThreads); 

     try { 
      // queue some tasks 
      for (int i = 0, nextId = startRange; i < noOfThreads; i++, nextId += noOfTasks) { 

       service.submit(new CassandraTask(nextId, noOfTasks)); 
      } 

      service.shutdown(); 

      service.awaitTermination(Long.MAX_VALUE, TimeUnit.DAYS); 
     } catch (InterruptedException e) { 
      LOG.warn("Threw a Interrupted Exception in" + CNAME + ".PelopsLnPClient: boss told me to stop...Not my fault!!"); 
     } catch (Exception e) { 
      LOG.error("Threw a Exception in" + CNAME + e); 
     } 
    } 

下面是CassandraTask class实施Runnable interface

class CassandraTask implements Runnable { 

    private final int id; 
    private final int noOfTasks; 

    private final String nodes = "localhost"; 
    private final String thrift_connection_pool = "Test Cluster"; 
    private final String keyspace = "my_keyspace"; 
    private final String column_family = "PROFILE_USER"; 

     public CassandraTask(int nextId, int noOfTasks) { 
      this.id = nextId; 
      this.noOfTasks = noOfTasks; 

     } 


     public void run() { 

      try { 

       cassandraConnection(); 
       Mutator mutator = Pelops.createMutator(thrift_connection_pool); 

       for (int userId = id; userId < id + noOfTasks; userId++) { 

        mutator.writeColumns(column_family, String.valueOf(userId), 
          mutator.newColumnList(
            mutator.newColumn("unt", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}"), 
            mutator.newColumn("rtising", "{\"lv\":[{\"v\":{\"thirdPartyAdsOnhostdomain\":null,\"hostdomainAdsOnThirdParty\":null,\"userId\":" + userId + "},\"cn\":2}],\"lmd\":20130206211109}"), 
            mutator.newColumn("selling_price_main_cats", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}"), 
            mutator.newColumn("and_keyword_rules", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}"), 
            mutator.newColumn("categories_purchased", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}"), 
            mutator.newColumn("omer_service", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}"), 
            mutator.newColumn("graphic", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}"), 
            mutator.newColumn("rite_searches", "{\"lv\":[{\"v\":{\"regSiteId\":null,\"userState\":null,\"userId\":" + userId + "},\"cn\":1}],\"lmd\":20130206211109}") 
            )); 
       } 

       mutator.execute(ConsistencyLevel.ONE); 

      } catch (Exception e) { 
       System.err.println("Threw a Exception in " + e); 
      } finally { 
       Pelops.shutdown(); 
      } 
     } 

     /** 
     * Making a Cassandra Connection by adding nodes 
     * 
     /
     private void cassandraConnection() { 

      Cluster cluster = new Cluster(nodes, 9160); 
      Pelops.addPool(thrift_connection_pool, cluster, keyspace); 

     } 
    } 

每当我跑步ng以上程序,我得到以下例外总是 -

Threw a Exception in java.lang.RuntimeException: exception while registering MBean, com.scale7.cassandra.pelops.pool:type=PooledNode-my_keyspace-localhost 

任何人都可以帮助我与这是什么错我在这里做什么?我相信我在这里犯了一些小错误?如果我缓慢地跑步,那么我不会得到这个例外。通过在代码中加入断点,我的意思是慢。不知何故很奇怪。

我与卡桑德拉1.2.3

任何帮助工作将不胜感激。

+0

,而不是这个'通信System.err.println(+ E“中扔了异常”);'你实际上可以使用e.printStackTrace(),并在发帖提问,所以我们可以得到更多的细节关于这个问题? – 2013-04-09 09:30:04

回答

1

您正在使用哪个客户端版本?据我所见,每个线程都会向cassandra创建一个池(同名!),并且每个线程都会关闭Pelops客户端。

在主类中移动创建池,只创建一个池并从线程访问它,并且从不调用Pelops.shutdown(),直到最后一个线程执行execute方法。

卡罗

+0

感谢卡罗的建议。之后它工作正常。但我只是想确保我做的事情是对的还是不对?因为我可能会遗漏一些小的细节。你可以看一下,让我知道我的更新代码是否与我创建cassandra连接和集群的方式一致。谢谢您的帮助。 – ferhan 2013-04-09 19:51:11

+0

据我所见,一切都很好 - 你连接到Cassandra的方式没问题,你可以添加一些其他的配置,但只有当你需要时......例如 'String nodes =“localhost”; int port = 9_160; boolean nodeDiscovery = true; Config casconf = new Config(port,true,0); Cluster cluster = new Cluster(nodes,casconf,nodeDiscovery); Pelops.addPool(thrift_connection_pool,簇,密钥空间);' 的Ciao,卡罗 – 2013-04-09 21:22:12

+0

至于 'mutator.newColumn( “LMD”,将String.valueOf(新的Date()的getTime())。)'我想记住你已经有了每列的时间戳,所以你可能不需要写它!更多请记住,使用Pelops你可以写长文字 'mutator.newColumn(“lmd”,Bytes.fromLong(System。currenttimemillis())' – 2013-04-09 21:28:02

相关问题