关于java:Ovirt中的云主机监控

Ovirt 中的云主机监控

1. PollVmStatsRefresher.java Vm 刷新调度器

   • poll() 调度执行办法

     @OnTimerMethodAnnotation("poll")
     public void poll() {if (isMonitoringNeeded(vdsManager.getStatus())) {
             // 负责获取虚拟机列表，并将其存储在 VdsManager 上进行剖析
             VmsListFetcher fetcher = new VmsStatisticsFetcher(vdsManager);
     
             long fetchTime = System.nanoTime();
             //fetcher.fetch()  调用 vdsm 接口，获取 AllVmStats 信息
             if (fetcher.fetch()) {
                 // 剖析监控到的主机的数据变动并做出解决。相干的更改将被长久化，状态转换和外部命令将相应地产生
                 getVmsMonitoring().perform(fetcher.getChangedVms(), fetchTime, vdsManager, true);
                 Stream<VdsmVm> vdsmVmsToMonitor = filterVmsToDevicesMonitoring(fetcher.getChangedVms());
                 processDevices(vdsmVmsToMonitor, fetchTime);
             } else {log.info("Failed to fetch vms info for host'{}'- skipping VMs monitoring.", vdsManager.getVdsName());
             }
         }
     }

   • startMonitoring() 启动调度 10-15s

     public void startMonitoring() {
         vmsMonitoringJob =
             schedulerService.scheduleWithFixedDelay(
                     this::poll,
                     VMS_REFRESH_RATE * NUMBER_VMS_REFRESHES_BEFORE_SAVE,
                     VMS_REFRESH_RATE * NUMBER_VMS_REFRESHES_BEFORE_SAVE,
                     TimeUnit.MILLISECONDS);
     }

2. VmsStatisticsFetcher.java 由 PollVmStatsRefresher.poll()调用

   VmsListFetcher fetcher = new VmsStatisticsFetcher(vdsManager);
   fetcher.fetch()  // 该办法会执行 vdsm 接口

   • fetch() 由 VmsStatisticsFetcher 继承 VmsListFetcher

     public boolean fetch() {VDSReturnValue pollReturnValue = poll();
         if (pollReturnValue.getSucceeded()) {vdsmVms = (Map<Guid, VdsmVm>) pollReturnValue.getReturnValue();
             // 该办法会对获取道德信息进行过滤，过滤处批改后的 vms 信息，并且会将 VmDynamic 信息存储到库中
             onFetchVms();
             return true;
         } else {onError();
             return false;
         }
     }

     poll()会被 VmsStatisticsFetcher 重写

   • poll() 调用 vdsm 接口GetAllVmStats

     @Override
     protected VDSReturnValue poll() {return getResourceManager().runVdsCommand(
                 VDSCommandType.GetAllVmStats,
                 new VdsIdVDSCommandParametersBase(vdsManager.getVdsId()));
     }

   • onFetchVms()

     protected void onFetchVms() {
         // 获取以后库中的 vms 信息
         dbVms = getVmDynamicDao().getAllRunningForVds(vdsManager.getVdsId()).stream()
                 .collect(Collectors.toMap(VmDynamic::getId, Function.identity()));
         changedVms = new ArrayList<>();
         // 过滤和比拟 dbVms、vdsmVms，如果 vm 状态产生扭转，则从新调用 vdsm 接口 GetVmStats，获取最新数据到 changeVms 中
         filterVms();
         // 过滤没有运行的云主机
         gatherNonRunningVms(dbVms);
         // 保留最新的 vms 列表
         saveLastVmsList();}

3. VmsMonitoring 调用手头的所有 Vm 分析器，遍历他们的报告并采取行动 - 触发 VDSM 命令(destroy,runrerun,migrate)，报告实现的操作，移交迁徙和保留到 db

   • perform() 由 PollVmStatsRefresher.poll()调用

     public void perform(
         List<Pair<VmDynamic, VdsmVm>> monitoredVms,
         long fetchTime,
         VdsManager vdsManager,
         boolean updateStatistics) {if (monitoredVms.isEmpty()) {return;}
     
         List<VmAnalyzer> vmAnalyzers = Collections.emptyList();
         try {vmAnalyzers = analyzeVms(monitoredVms, fetchTime, vdsManager, updateStatistics);
             // It is important to add the unmanaged VMs before flushing the dynamic data into the database
             addUnmanagedVms(vmAnalyzers, vdsManager.getVdsId());
             flush(vmAnalyzers);
             postFlush(vmAnalyzers, vdsManager, fetchTime);
             vdsManager.vmsMonitoringInitFinished();} catch (RuntimeException ex) {log.error("Failed during vms monitoring on host {} error is: {}", vdsManager.getVdsName(), ex);
             log.error("Exception:", ex);
         } finally {unlockVms(vmAnalyzers);
         }
     
     }

   • analyzeVms() 剖析虚拟机，获取剖析后果

     /**
     * Analyze the VM data pair
     * Skip analysis on VMs which cannot be locked
     * note: metrics calculation like memCommited and vmsCoresCount should be calculated *before*
     *   this filtering.
     * @return The analyzers which hold all the data per VM
     */
     private List<VmAnalyzer> analyzeVms(
           List<Pair<VmDynamic, VdsmVm>> monitoredVms,
           long fetchTime,
           VdsManager vdsManager,
           boolean updateStatistics) {VmAnalyzerFactory vmAnalyzerFactory = getVmAnalyzerFactory(vdsManager, updateStatistics);
       List<VmAnalyzer> vmAnalyzers = new ArrayList<>(monitoredVms.size());
       monitoredVms.forEach(vm -> {
           // TODO filter out migratingTo VMs if no action is taken on them
           if (shouldAnalyzeVm(vm, fetchTime, vdsManager.getVdsId())) {
               try {VmAnalyzer vmAnalyzer = vmAnalyzerFactory.getVmAnalyzer(vm);
                   vmAnalyzer.analyze();
                   vmAnalyzers.add(vmAnalyzer);
               } catch (RuntimeException ex) {Guid vmId = getVmId(vm.getFirst(), vm.getSecond());
                   VmManager vmManager = getVmManager(vmId);
                   vmManager.unlock();
     
                   log.error("Failed during monitoring vm: {} , error is: {}", vmId, ex);
                   log.error("Exception:", ex);
               }
           }
       });
       vmAnalyzers.sort(Comparator.comparing(VmAnalyzer::getVmId));
       return vmAnalyzers;
     }

   • flush(vmAnalyzers) 保留 vm 数据

     private void flush(List<VmAnalyzer> vmAnalyzers) {saveVmDynamic(vmAnalyzers);
         saveVmStatistics(vmAnalyzers);
         saveVmInterfaceStatistics(vmAnalyzers);
         saveVmDiskImageStatistics(vmAnalyzers);
         saveVmGuestAgentNetworkDevices(vmAnalyzers);
     }

总结

1. 在云主机中，监控信息通过 vm_interface_view 查问进去的，vm_interface_view 查问表 vm_interface_statistics 中的数据表。

2. ovirt 对云主机有一个调度工作，去获取 vds 主机上理论云主机信息，来同步本地云主机。大抵过程为：

   1. 创立调度办法，并启动调度。
   2. 在调度办法中，ovirt 判断 vds 的状态是否须要监控
   3. ovirt 会先调用 vdsm 接口 GetAllVmStats 获取全副的 vmsStatic 信息，并与以后库中的 dbVms 信息作比照，次要比拟 dbvm 是否为空，以及单方状态是否统一
   4. 比拟之后会从新调用 vdsm 接口 GetVmStats 获取须要批改的 vms 信息
   5. ovirt 会依据批改的 vms 信息，剖析其变动并做出反馈。相干的更改将被长久化，状态转换和外部命令将相应地产生