近期目标
好好学习Hadoop!
  推荐文章
Kubernetes

Calico Practicing-2 -- About Calico Networking Option

Our on-premise environment consists of several VLAN(layer 2 network), each VLAN is created by VCenter. Physically, every VLAN is based on several bare metal machines on the same floor, the bare metal machines are connected by ethernet switches. And we have several floors of bare metal machines, they're connected by ToR(Top of Rack) routers(layer 3 network).

阅读更多
Kubernetes

Calico Practicing-1 -- About Calico

I'm going to talk about my comprehension about Calico.

阅读更多
Kubernetes

Calico Practicing-3 -- How To Configure Accessing Calico Endpoint From Outside of The Cluster

Our software technology stack is mainly Java with micro-service frameworks(e.g. Spring Boot, Consul). And we're moving from VM to Kubernetes. Considering cases of putting consumer or/and registry conponents outside of the Kubernetes cluster, we have to make our network plane allows workload accessing Pod IP, Service IP from outside the Kubernetes cluster.

阅读更多
大数据

MapReduce Computation Framework

MapReduce既是编程模型又是计算框架,尽管对于我们来说只需要实现map和reduce函数就能完成业务,但是前提是要对MapReduce编程框架的内部机制有清晰的概念。

阅读更多
大数据

YARN Architecture

YARN是一个集群资源调度框架,其思想是将资源管理和作业调度/监视的功能拆分为单独的守护程序。对于应用开发者来说,几乎不需要自定义YARN本身的程序,对于管理员来说,还需要熟悉如何查看日志、如何配置队列、用户ACL等操作,这些工作实操性比较强。

阅读更多
监控

开发Zabbix的自定义监控项和自动发现AWS服务实例

在Zabbix中添加自定义监控项,以及如何配置自动发现的一系列操作。把公有云服务监控整合到Zabbix中。

阅读更多
监控

使用Docker部署Zabbix监控系统来监控主机状态

使用 [monitoring/zabbix-docker-monitoring](https://github.com/monitoringartist/zabbix-docker-monitoring) 的镜像来部署 Zabbix,Zabbix 的 `server`、`proxy`、`agent` 包括 `server` 的 `Mariadb`,全部都是容器化部署。感兴趣的可以阅读 GitHub 原文以了解更多。

阅读更多
DevOps

使用官方 CloudFormation 模板部署 EKS

CloudFormation 是 AWS 自家的云服务编排工具,本文介绍了如何使用官方 CloudFormation 模板部署AWS EKS。

阅读更多
Docker

分析Dockbix的Dockerfile--通用的多程序镜像的设计思路

一般来说一个软件的镜像的最后由`ENTRYPOINT`和`CMD`来构成,有的镜像可能没有`ENTRYPOINT`, `ENTRYPOINT`和`CMD`的主要区别在于即使你在运行镜像时指定了“命令” (e.g. `docker run nginx echo "test"`的`echo "test"`部分就是“命令”),`ENTRYPOINT`中 指定的命令(e.g. `ENTRYPOINT entrypoint.sh`)也不会被忽略。 总的来说,可以把以下几条规则当做创作Dockerfile的thumb rules: - `RUN`: 用来安装软件或添加依赖,因为`RUN`会创建一层`layer`。 - `ENTRYPOINT`: 用来指定该镜像为可执行程序,并且指定一个一个脚本用来初始化基础环境( e.g. 创建镜像运行时所使用的用户、加载程序的依赖、初始化环境变量等。)。 - `CMD`: 用来运行软件。 - `ENTRYPOINT`与`CMD`结合使用: 在`ENTRYPOINT entrypoint.sh`中初始化环境,最后执行`exec "$@"`,以此来继续执行 `CMD`中的内容。

阅读更多
YARN Architecture YARN Architecture
YARN是一个集群资源调度框架,其思想是将资源管理和作业调度/监视的功能拆分为单独的守护程序。对于应用开发者来说,几乎不需要自定义YARN本身的程序,对于管理员来说,还需要熟悉如何查看日志、如何配置队列、用户ACL等操作,这些工作实操性比较强。
2020-10-26
ClouderaManager Setup Kerberos Missing Credentials ClouderaManager Setup Kerberos Missing Credentials
我在Linux服务器上安装了MIT Kerberos server,然后在Cloudera Manager上通过Web UI向导进行启用Kerberos的初始化。过程执行失败了,刷新CLoudera Manager的首页后发现许多Configuration Issues,提示说各个服务的Kerberos Credentials是missing的状态。
2020-10-19
MapReduce Computation Framework MapReduce Computation Framework
MapReduce既是编程模型又是计算框架,尽管对于我们来说只需要实现map和reduce函数就能完成业务,但是前提是要对MapReduce编程框架的内部机制有清晰的概念。
2020-10-15
MapReduce Programming Model MapReduce Programming Model
MapReduce既是一个编程模型,又是一个计算框架。由于我们的数据是存放在分布式文件系统中,自然不能用传统的编程模型来完成任务了。
2020-10-06
HDFS Architecture and Explaination of Design HDFS Architecture and Explaination of Design
HDFS Architecture and Explaination of Design
2020-09-29
使用官方 CloudFormation 模板部署 EKS 使用官方 CloudFormation 模板部署 EKS
CloudFormation 是 AWS 自家的云服务编排工具,本文介绍了如何使用官方 CloudFormation 模板部署AWS EKS。
2020-06-09
Quick guide to deploying and using Traefik 2.0 on Kubernetes Quick guide to deploying and using Traefik 2.0 on Kubernetes
本文介绍了如何在Kubernetes中部署Traefik 2.0以及如何配置路由。
2020-04-08
Change Rook Ceph filestore Change Rook Ceph filestore
By default, Rook Ceph is dynamically set to `fileStore` if a data dir is set and created on the host. This article instructs how to use `blueStore` as `storeType` in Rook Ceph.
2020-03-23
Ceph Performance Testing Ceph Performance Testing
Rook Ceph performance testing. Contrast of EC block and Replicated block.
2020-03-23
About-Rook-Ceph About-Rook-Ceph
In Kubernetes, StatefulSet is designed to address the topological and storage state of the application. And we usually need to use storage services to provide to StatefulSet to use. Ceph is a popular open source distributed storage solution. Rook can help us deploy and use Ceph in k8s.
2020-03-18
Calico Practicing-3 -- How To Configure Accessing Calico Endpoint From Outside of The Cluster Calico Practicing-3 -- How To Configure Accessing Calico Endpoint From Outside of The Cluster
Our software technology stack is mainly Java with micro-service frameworks(e.g. Spring Boot, Consul). And we're moving from VM to Kubernetes. Considering cases of putting consumer or/and registry conponents outside of the Kubernetes cluster, we have to make our network plane allows workload accessing Pod IP, Service IP from outside the Kubernetes cluster.
2020-01-19
Calico Practicing-2 -- About Calico Networking Option Calico Practicing-2 -- About Calico Networking Option
Our on-premise environment consists of several VLAN(layer 2 network), each VLAN is created by VCenter. Physically, every VLAN is based on several bare metal machines on the same floor, the bare metal machines are connected by ethernet switches. And we have several floors of bare metal machines, they're connected by ToR(Top of Rack) routers(layer 3 network).
2020-01-19
1 / 3