7月安卓手機(jī)性能榜：紅魔8S Pro再奪榜首
7月份的手機(jī)市場風(fēng)平浪靜，除了紅魔和努比亞帶來了兩款搭載驍龍8Gen2領(lǐng)先版處理器的新機(jī)之外，別的也想不到有什么新品了，這也正常，通常6月7月都是手機(jī)廠商修整的時(shí)間，進(jìn)入8月份之
Caffeine緩存是一個(gè)高性能、可擴(kuò)展、內(nèi)存優(yōu)化的 Java 緩存庫，基于 Google 的 Guava Cache演進(jìn)而來并提供了接近最佳的命中率。
Caffeine 緩存包含以下特點(diǎn)：
正是因?yàn)镃affeine具備的上述特性，Caffeine作為項(xiàng)目中本地緩存的不二選擇，越來越多的項(xiàng)目集成了Caffeine的功能，進(jìn)而衍生了一系列的業(yè)務(wù)視角的需求。
日常使用的需求之一希望能夠?qū)崟r(shí)評(píng)估Caffeine實(shí)例的內(nèi)存占用情況并能夠提供動(dòng)態(tài)調(diào)整緩存參數(shù)的能力，但是已有的內(nèi)存分析工具M(jìn)AT需要基于dump的文件進(jìn)行分析無法做到實(shí)時(shí)，這也是整個(gè)事情的起因之一。
基于上述的需求背景，結(jié)合caffeine的已有功能和定制的部分源碼開發(fā)，整體作為caffeine可視化的技術(shù)項(xiàng)目進(jìn)行推進(jìn)和落地。
Caffeine可視化項(xiàng)目目前已支持功能包括：
說明：
說明：
說明：
說明：
說明：
Caffeine框架功能整合
說明：
Caffeine可視化框架
說明：
業(yè)務(wù)層-緩存對(duì)象的管理
static Cache<String, List<String>> accountWhiteCache = Caffeine.newBuilder() .expireAfterWrite(VivoConfigManager.getInteger("trade.account.white.list.cache.ttl", 10), TimeUnit.MINUTES) .recordStats().maximumSize(VivoConfigManager.getInteger("trade.account.white.list.cache.size", 100)).build();常規(guī)的Caffeine實(shí)例的創(chuàng)建方式 static Cache<String, List<String>> accountWhiteCache = Caffeine.newBuilder().applyName("accountWhiteCache") .expireAfterWrite(VivoConfigManager.getInteger("trade.account.white.list.cache.ttl", 10), TimeUnit.MINUTES) .recordStats().maximumSize(VivoConfigManager.getInteger("trade.account.white.list.cache.size", 100)).build();支持實(shí)例命名的Caffeine實(shí)例的創(chuàng)建方式說明：
public final class Caffeine<K, V> { /** * caffeine的實(shí)例名稱 */ String instanceName; /** * caffeine的實(shí)例維護(hù)的Map信息 */ static Map<String, Cache> cacheInstanceMap = new ConcurrentHashMap<>(); @NonNull public <K1 extends K, V1 extends V> Cache<K1, V1> build() { requireWeightWithWeigher(); requireNonLoadingCache(); @SuppressWarnings("unchecked") Caffeine<K1, V1> self = (Caffeine<K1, V1>) this; Cache localCache = isBounded() ? new BoundedLocalCache.BoundedLocalManualCache<>(self) : new UnboundedLocalCache.UnboundedLocalManualCache<>(self); if (null != localCache && StringUtils.isNotEmpty(localCache.getInstanceName())) { cacheInstanceMap.put(localCache.getInstanceName(), localCache); } return localCache; }}說明：
業(yè)務(wù)層-內(nèi)存占用的預(yù)估
import jdk.nashorn.internal.ir.debug.ObjectSizeCalculator; public abstract class BoundedLocalCache<K, V> extends BLCHeader.DrainStatusRef<K, V> implements LocalCache<K, V> { final ConcurrentHashMap<Object, Node<K, V>> data; @Override public long getMemoryUsed() { // 預(yù)估內(nèi)存占用 return ObjectSizeCalculator.getObjectSize(data); }}說明：
業(yè)務(wù)層-數(shù)據(jù)上報(bào)機(jī)制
public static StatsData getCacheStats(String instanceName) { Cache cache = Caffeine.getCacheByInstanceName(instanceName); CacheStats cacheStats = cache.stats(); StatsData statsData = new StatsData(); statsData.setInstanceName(instanceName); statsData.setTimeStamp(System.currentTimeMillis()/1000); statsData.setMemoryUsed(String.valueOf(cache.getMemoryUsed())); statsData.setEstimatedSize(String.valueOf(cache.estimatedSize())); statsData.setRequestCount(String.valueOf(cacheStats.requestCount())); statsData.setHitCount(String.valueOf(cacheStats.hitCount())); statsData.setHitRate(String.valueOf(cacheStats.hitRate())); statsData.setMissCount(String.valueOf(cacheStats.missCount())); statsData.setMissRate(String.valueOf(cacheStats.missRate())); statsData.setLoadCount(String.valueOf(cacheStats.loadCount())); statsData.setLoadSuccessCount(String.valueOf(cacheStats.loadSuccessCount())); statsData.setLoadFailureCount(String.valueOf(cacheStats.loadFailureCount())); statsData.setLoadFailureRate(String.valueOf(cacheStats.loadFailureRate())); Optional<Eviction> optionalEviction = cache.policy().eviction(); optionalEviction.ifPresent(eviction -> statsData.setMaximumSize(String.valueOf(eviction.getMaximum()))); Optional<Expiration> optionalExpiration = cache.policy().expireAfterWrite(); optionalExpiration.ifPresent(expiration -> statsData.setExpireAfterWrite(String.valueOf(expiration.getExpiresAfter(TimeUnit.SECONDS)))); optionalExpiration = cache.policy().expireAfterAccess(); optionalExpiration.ifPresent(expiration -> statsData.setExpireAfterAccess(String.valueOf(expiration.getExpiresAfter(TimeUnit.SECONDS)))); optionalExpiration = cache.policy().refreshAfterWrite(); optionalExpiration.ifPresent(expiration -> statsData.setRefreshAfterWrite(String.valueOf(expiration.getExpiresAfter(TimeUnit.SECONDS)))); return statsData;}說明：
public static void sendReportData() { try { if (!VivoConfigManager.getBoolean("memory.caffeine.data.report.switch", true)) { return; } // 1、獲取所有的cache實(shí)例對(duì)象 Method listCacheInstanceMethod = HANDLER_MANAGER_CLASS.getMethod("listCacheInstance", null); List<String> instanceNames = (List)listCacheInstanceMethod.invoke(null, null); if (CollectionUtils.isEmpty(instanceNames)) { return; } String appName = System.getProperty("app.name"); String localIp = getLocalIp(); String localPort = String.valueOf(NetPortUtils.getWorkPort()); ReportData reportData = new ReportData(); InstanceData instanceData = new InstanceData(); instanceData.setAppName(appName); instanceData.setIp(localIp); instanceData.setPort(localPort); // 2、遍歷cache實(shí)例對(duì)象獲取緩存監(jiān)控?cái)?shù)據(jù) Method getCacheStatsMethod = HANDLER_MANAGER_CLASS.getMethod("getCacheStats", String.class); Map<String, StatsData> statsDataMap = new HashMap<>(); instanceNames.stream().forEach(instanceName -> { try { StatsData statsData = (StatsData)getCacheStatsMethod.invoke(null, instanceName); statsDataMap.put(instanceName, statsData); } catch (Exception e) { } }); // 3、構(gòu)建上報(bào)對(duì)象 reportData.setInstanceData(instanceData); reportData.setStatsDataMap(statsDataMap); // 4、發(fā)送Http的POST請(qǐng)求 HttpPost httpPost = new HttpPost(getReportDataUrl()); httpPost.setConfig(requestConfig); StringEntity stringEntity = new StringEntity(JSON.toJSONString(reportData)); stringEntity.setContentType("application/json"); httpPost.setEntity(stringEntity); HttpResponse response = httpClient.execute(httpPost); String result = EntityUtils.toString(response.getEntity(),"UTF-8"); EntityUtils.consume(response.getEntity()); logger.info("Caffeine 數(shù)據(jù)上報(bào)成功 URL {} 參數(shù) {} 結(jié)果 {}", getReportDataUrl(), JSON.toJSONString(reportData), result); } catch (Throwable throwable) { logger.error("Caffeine 數(shù)據(jù)上報(bào)失敗 URL {} ", getReportDataUrl(), throwable); }}說明：
業(yè)務(wù)層-配置動(dòng)態(tài)下發(fā)
public static ExecutionResponse dispose(ExecutionRequest request) { ExecutionResponse executionResponse = new ExecutionResponse(); executionResponse.setCmdType(CmdTypeEnum.INSTANCE_CONFIGURE.getCmd()); executionResponse.setInstanceName(request.getInstanceName()); String instanceName = request.getInstanceName(); Cache cache = Caffeine.getCacheByInstanceName(instanceName); // 設(shè)置緩存的最大條目 if (null != request.getMaximumSize() && request.getMaximumSize() > 0) { Optional<Eviction> optionalEviction = cache.policy().eviction(); optionalEviction.ifPresent(eviction ->eviction.setMaximum(request.getMaximumSize())); } // 設(shè)置寫后過期的過期時(shí)間 if (null != request.getExpireAfterWrite() && request.getExpireAfterWrite() > 0) { Optional<Expiration> optionalExpiration = cache.policy().expireAfterWrite(); optionalExpiration.ifPresent(expiration -> expiration.setExpiresAfter(request.getExpireAfterWrite(), TimeUnit.SECONDS)); } // 設(shè)置訪問過期的過期時(shí)間 if (null != request.getExpireAfterAccess() && request.getExpireAfterAccess() > 0) { Optional<Expiration> optionalExpiration = cache.policy().expireAfterAccess(); optionalExpiration.ifPresent(expiration -> expiration.setExpiresAfter(request.getExpireAfterAccess(), TimeUnit.SECONDS)); } // 設(shè)置寫更新的過期時(shí)間 if (null != request.getRefreshAfterWrite() && request.getRefreshAfterWrite() > 0) { Optional<Expiration> optionalExpiration = cache.policy().refreshAfterWrite(); optionalExpiration.ifPresent(expiration -> expiration.setExpiresAfter(request.getRefreshAfterWrite(), TimeUnit.SECONDS)); } executionResponse.setCode(0); executionResponse.setMsg("success"); return executionResponse;}說明：
業(yè)務(wù)層-緩存數(shù)據(jù)清空
/** * 失效緩存的值 * @param request * @return */ public static ExecutionResponse invalidate(ExecutionRequest request) { ExecutionResponse executionResponse = new ExecutionResponse(); executionResponse.setCmdType(CmdTypeEnum.INSTANCE_INVALIDATE.getCmd()); executionResponse.setInstanceName(request.getInstanceName()); try { // 查找對(duì)應(yīng)的cache實(shí)例 String instanceName = request.getInstanceName(); Cache cache = Caffeine.getCacheByInstanceName(instanceName); // 處理清空指定實(shí)例的所有緩存 或 指定實(shí)例的key對(duì)應(yīng)的緩存 Object cacheKeyObj = request.getCacheKey(); // 清除所有緩存 if (Objects.isNull(cacheKeyObj)) { cache.invalidateAll(); } else { // 清除指定key對(duì)應(yīng)的緩存 if (Objects.equals(request.getCacheKeyType(), 2)) { cache.invalidate(Long.valueOf(request.getCacheKey().toString())); } else if (Objects.equals(request.getCacheKeyType(), 3)) { cache.invalidate(Integer.valueOf(request.getCacheKey().toString())); } else { cache.invalidate(request.getCacheKey().toString()); } } executionResponse.setCode(0); executionResponse.setMsg("success"); } catch (Exception e) { executionResponse.setCode(-1); executionResponse.setMsg("fail"); } return executionResponse; }}業(yè)務(wù)層-緩存數(shù)據(jù)查詢
public static ExecutionResponse inspect(ExecutionRequest request) { ExecutionResponse executionResponse = new ExecutionResponse(); executionResponse.setCmdType(CmdTypeEnum.INSTANCE_INSPECT.getCmd()); executionResponse.setInstanceName(request.getInstanceName()); String instanceName = request.getInstanceName(); Cache cache = Caffeine.getCacheByInstanceName(instanceName); Object cacheValue = cache.getIfPresent(request.getCacheKey()); if (Objects.equals(request.getCacheKeyType(), 2)) { cacheValue = cache.getIfPresent(Long.valueOf(request.getCacheKey().toString())); } else if (Objects.equals(request.getCacheKeyType(), 3)) { cacheValue = cache.getIfPresent(Integer.valueOf(request.getCacheKey().toString())); } else { cacheValue = cache.getIfPresent(request.getCacheKey().toString()); } if (Objects.isNull(cacheValue)) { executionResponse.setData(""); } else { executionResponse.setData(JSON.toJSONString(cacheValue)); } return executionResponse;}說明：
通信層-監(jiān)聽服務(wù)
public class ServerManager { private Server jetty; /** * 創(chuàng)建jetty對(duì)象 * @throws Exception */ public ServerManager() throws Exception { int port = NetPortUtils.getAvailablePort(); jetty = new Server(port); ServletContextHandler context = new ServletContextHandler(ServletContextHandler.NO_SESSIONS); context.setContextPath("/"); context.addServlet(ClientServlet.class, "/caffeine"); jetty.setHandler(context); } /** * 啟動(dòng)jetty對(duì)象 * @throws Exception */ public void start() throws Exception { jetty.start(); }} public class ClientServlet extends HttpServlet { private static final Logger logger = LoggerFactory.getLogger(ClientServlet.class); @Override protected void doGet(HttpServletRequest req, HttpServletResponse resp) throws ServletException, IOException { super.doGet(req, resp); } @Override protected void doPost(HttpServletRequest req, HttpServletResponse resp) throws ServletException, IOException { ExecutionResponse executionResponse = null; String requestJson = null; try { // 獲取請(qǐng)求的相關(guān)的參數(shù) String contextPath = req.getContextPath(); String servletPath = req.getServletPath(); String requestUri = req.getRequestURI(); requestJson = IOUtils.toString(req.getInputStream(), StandardCharsets.UTF_8); // 處理不同的命令 ExecutionRequest executionRequest = JSON.parseObject(requestJson, ExecutionRequest.class); // 通過反射來來處理類依賴問題 executionResponse = DisposeCenter.dispatch(executionRequest); } catch (Exception e) { logger.error("vivo-memory 處理請(qǐng)求異常 {} ", requestJson, e); } if (null == executionResponse) { executionResponse = new ExecutionResponse(); executionResponse.setCode(-1); executionResponse.setMsg("處理異常"); } // 組裝相應(yīng)報(bào)文 resp.setContentType("application/json; charset=utf-8"); PrintWriter out = resp.getWriter(); out.println(JSON.toJSONString(executionResponse)); out.flush(); }}說明：
通信層-心跳設(shè)計(jì)
/** * 發(fā)送心跳數(shù)據(jù) */public static void sendHeartBeatData() { try { if (!VivoConfigManager.getBoolean("memory.caffeine.heart.report.switch", true)) { return; } // 1、構(gòu)建心跳數(shù)據(jù) String appName = System.getProperty("app.name"); String localIp = getLocalIp(); String localPort = String.valueOf(NetPortUtils.getWorkPort()); HeartBeatData heartBeatData = new HeartBeatData(); heartBeatData.setAppName(appName); heartBeatData.setIp(localIp); heartBeatData.setPort(localPort); heartBeatData.setTimeStamp(System.currentTimeMillis()/1000); // 2、發(fā)送Http的POST請(qǐng)求 HttpPost httpPost = new HttpPost(getHeartBeatUrl()); httpPost.setConfig(requestConfig); StringEntity stringEntity = new StringEntity(JSON.toJSONString(heartBeatData)); stringEntity.setContentType("application/json"); httpPost.setEntity(stringEntity); HttpResponse response = httpClient.execute(httpPost); String result = EntityUtils.toString(response.getEntity(),"UTF-8"); EntityUtils.consume(response.getEntity()); logger.info("Caffeine 心跳上報(bào)成功 URL {} 參數(shù) {} 結(jié)果 {}", getHeartBeatUrl(), JSON.toJSONString(heartBeatData), result); } catch (Throwable throwable) { logger.error("Caffeine 心跳上報(bào)失敗 URL {} ", getHeartBeatUrl(), throwable); }}說明：
vivo技術(shù)團(tuán)隊(duì)在Caffeine的使用經(jīng)驗(yàn)上曾有過多次分享，可參考公眾號(hào)文章《如何把 Caffeine Cache 用得如絲般順滑》，此篇文章在使用的基礎(chǔ)上基于使用痛點(diǎn)進(jìn)行進(jìn)一步的定制。
目前Caffeine可視化的項(xiàng)目已經(jīng)在相關(guān)核心業(yè)務(wù)場景中落地并發(fā)揮作用，整體運(yùn)行平穩(wěn)。使用較多的功能包括項(xiàng)目維度的caffeine實(shí)例的全局管控，單實(shí)例維度的內(nèi)存占用評(píng)估和緩存命中趨勢(shì)評(píng)估。
如通過單實(shí)例的內(nèi)存占用評(píng)估功能能夠合理評(píng)估緩存條目設(shè)置和內(nèi)存占用之間的關(guān)系；通過分析緩存命中率的整體趨勢(shì)評(píng)估緩存的參數(shù)設(shè)置合理性。
期待此篇文章能夠給業(yè)界緩存使用和監(jiān)控帶來一些新思路。
本文鏈接：http://www.www897cc.com/showinfo-26-103570-0.html緩存框架 Caffeine 的可視化探索與實(shí)踐
聲明：本網(wǎng)頁內(nèi)容旨在傳播知識(shí)，若有侵權(quán)等問題請(qǐng)及時(shí)與本網(wǎng)聯(lián)系，我們將在第一時(shí)間刪除處理。郵件：2376512515@qq.com
Copyright ? 2016-2023 天津谷騏科技有限公司 版權(quán)所有 sitemap.xml
違法及侵權(quán)請(qǐng)聯(lián)系：2376512515@qq.com 津ICP備18001702號(hào)
津公網(wǎng)安備 12010102000574號(hào)