我正在研究redis。我使用三个主节点构建了我的Redis集群,并且还有另一个运行ycsb的节点。我遇到了与 To start YCSB load with cluster enabled option for REDIS中所述相同的问题。 我试着根据给出的答案编辑RedisClient.java。不过,我得到的错误: import redis.clients.jedis.HostAndPort; import redis.clients.jedis.JedisCluster; ,因为这些软件包不存在。所以我的问题是在哪里可以找到像redis.clients.jedis.JedisCluster这样的软件包?有没有人成功编辑RedisClient.java来测试Redis集群,还是我们有其他解决方案?谢谢!由于我们没有redis集群的绑定,所以如何运行ycsb来测试redis集群?
0
A
回答
1
来自ycsb的默认redis客户端不支持redis集群。因此,要使用ycsb对redis集群进行基准测试,我们必须对redis客户端(RedisClient.java)进行调整,并使用maven重新编译代码。下面的代码为我工作:
/**
* Copyright (c) 2012 YCSB contributors. All rights reserved.
*
* Licensed under the Apache License, Version 2.0 (the "License"); you
* may not use this file except in compliance with the License. You
* may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing, software
* distributed under the License is distributed on an "AS IS" BASIS,
* WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or
* implied. See the License for the specific language governing
* permissions and limitations under the License. See accompanying
* LICENSE file.
*/
/**
* Redis client binding for YCSB.
*
* All YCSB records are mapped to a Redis *hash field*. For scanning
* operations, all keys are saved (by an arbitrary hash) in a sorted set.
*/
package com.yahoo.ycsb.db;
import com.yahoo.ycsb.ByteIterator;
import com.yahoo.ycsb.DB;
import com.yahoo.ycsb.DBException;
import com.yahoo.ycsb.Status;
import com.yahoo.ycsb.StringByteIterator;
import redis.clients.jedis.Protocol;
import java.util.HashMap;
import java.util.Iterator;
import java.util.List;
import java.util.Properties;
import java.util.Set;
import java.util.Vector;
import redis.clients.jedis.HostAndPort;
import redis.clients.jedis.JedisCluster;
import java.util.HashSet;
/**
* YCSB binding for <a href="http://redis.io/">Redis</a>.
*
* See {@code redis/README.md} for details.
*/
public class RedisClient extends DB {
private JedisCluster jedis;
public static final String HOST_PROPERTY = "redis.host";
public static final String PORT_PROPERTY = "redis.port";
public static final String PASSWORD_PROPERTY = "redis.password";
public static final String INDEX_KEY = "_indices";
public void init() throws DBException {
Properties props = getProperties();
int port;
Set<HostAndPort> jedisClusterNodes = new HashSet<HostAndPort>();
String portString = props.getProperty(PORT_PROPERTY);
if (portString != null) {
port = Integer.parseInt(portString);
} else {
port = Protocol.DEFAULT_PORT;
}
String host = props.getProperty(HOST_PROPERTY);
jedisClusterNodes.add(new HostAndPort(host, port));
jedis = new JedisCluster(jedisClusterNodes);
String password = props.getProperty(PASSWORD_PROPERTY);
if (password != null) {
jedis.auth(password);
}
}
public void cleanup() throws DBException {
}
/*
* Calculate a hash for a key to store it in an index. The actual return value
* of this function is not interesting -- it primarily needs to be fast and
* scattered along the whole space of doubles. In a real world scenario one
* would probably use the ASCII values of the keys.
*/
private double hash(String key) {
return key.hashCode();
}
// XXX jedis.select(int index) to switch to `table`
@Override
public Status read(String table, String key, Set<String> fields,
HashMap<String, ByteIterator> result) {
if (fields == null) {
StringByteIterator.putAllAsByteIterators(result, jedis.hgetAll(key));
} else {
String[] fieldArray =
(String[]) fields.toArray(new String[fields.size()]);
List<String> values = jedis.hmget(key, fieldArray);
Iterator<String> fieldIterator = fields.iterator();
Iterator<String> valueIterator = values.iterator();
while (fieldIterator.hasNext() && valueIterator.hasNext()) {
result.put(fieldIterator.next(),
new StringByteIterator(valueIterator.next()));
}
assert !fieldIterator.hasNext() && !valueIterator.hasNext();
}
return result.isEmpty() ? Status.ERROR : Status.OK;
}
@Override
public Status insert(String table, String key,
HashMap<String, ByteIterator> values) {
if (jedis.hmset(key, StringByteIterator.getStringMap(values))
.equals("OK")) {
jedis.zadd(INDEX_KEY, hash(key), key);
return Status.OK;
}
return Status.ERROR;
}
@Override
public Status delete(String table, String key) {
return jedis.del(key) == 0 && jedis.zrem(INDEX_KEY, key) == 0 ? Status.ERROR
: Status.OK;
}
@Override
public Status update(String table, String key,
HashMap<String, ByteIterator> values) {
return jedis.hmset(key, StringByteIterator.getStringMap(values))
.equals("OK") ? Status.OK : Status.ERROR;
}
@Override
public Status scan(String table, String startkey, int recordcount,
Set<String> fields, Vector<HashMap<String, ByteIterator>> result) {
Set<String> keys = jedis.zrangeByScore(INDEX_KEY, hash(startkey),
Double.POSITIVE_INFINITY, 0, recordcount);
HashMap<String, ByteIterator> values;
for (String key : keys) {
values = new HashMap<String, ByteIterator>();
read(table, key, fields, values);
result.add(values);
}
return Status.OK;
}
}
我认为可能对他人有所帮助:)
相关问题
- 1. Redis HA没有集群
- 2. 如何使用Sentinel运行Redis集群
- 3. 如何保护Redis集群?
- 4. Redis集群和zsets
- 5. Redis中的Redis集群支持2.8.19
- 6. Redis的群集错误
- 7. kubernetes上的Redis集群
- 8. 应在Redis的集群
- 9. Redis命令获取Redis集群上的所有可用密钥?
- 10. spring-data-redis是否支持redis集群?
- 11. socket.io-redis是否支持redis集群?
- 12. Kubernetes Redis集群问题
- 13. Ignite Vs Redis Websession集群
- 14. Redis群集 - 从站不FAILOVER
- 15. Redis集群通过HAProxy
- 16. Raise Redis集群授权
- 17. 如何解决的Redis集群“等待集群加盟”的问题
- 18. 负载平衡器上的Redis集群
- 19. Spring引导的Redis集群配置
- 20. 启用群集模式的Redis锁
- 21. Akka集群感知路由器 - 共享redis实例到所有路由器
- 22. 将Redis数据迁移到群集
- 23. 无法启动Redis集群服务器
- 24. AwsElastiCache创建Redis集群:CreateCacheCluster()与CreateReplicationGroup()
- 25. Redis集群就绪客户端
- 26. Redis群集需要AOF还是RDB?
- 27. 通过Sentinel连接到Redis集群
- 28. spring data redis集群管道支持
- 29. 从Peered VPC连接到Elasticache Redis群集
- 30. 我需要一个用于redis集群的scala客户端库