《kafka简介说课材料》由会员分享，可在线阅读，更多相关《kafka简介说课材料（12页珍藏版）》请在金锄头文库上搜索。
1、睿智生活，是一种,面对惊涛骇浪，泰然处之,2014/07/04,Kafka ？,Kafka：分布式的（distributed）可分区的（ partitioned）基于备份的（ replicated ）基于commit log 存储的服务 Topic:kafka根据topic归类消息，一类消息是一个topic Producer: 发布消息 Consumer: 订阅消息 Broker: kafka cluster 中每一个节点,Kafka 简介,client-server :tcp协议,Topics,一个topic是一类消息，每个topic被分成多个parttion，每个part在存储层面是app
2、end log,偏移量(offset):消息的位置，一个long型数字,它唯一的标记一条消息,Topics/log,当segment文件尺寸达到一定阀值时(可以通过配置文件设定,默认1G),将会创建一个新的文件; 当buffer中消息的条数达到阀值时将会触发日志信息flush到日志文件中; 距离最近一次flush的时间差达到阀值时,也会触发flush到日志文件; 如果broker失效,极有可能会丢失那些尚未flush到文件的消息,Kafka-consumer,Kafka-partition,区：分布在kafka集群中多个server，还可以配置备份（replication）,Zookeeper
3、,Broker node registry Broker Topic Registry Consumer and Consumer group Consumer id Registry Consumeroffset Tracking Partition Owner registry 。,构建简单kafka环境,tar -xzf kafka_2.9.2-0.8.1.1.tgz cd kafka_2.9.2-0.8.1.1 bin/zookeeper-server-start.sh config/zookeeper.properties bin/kafka-server-start.sh conf
4、ig/server.properties bin/kafka-topics.sh -create -zookeeper localhost:2181 -replication-factor 1 -partitions 1 -topic test bin/kafka-topics.sh -list -zookeeper localhost:2181 bin/kafka-console-producer.sh -broker-list localhost:9092 -topic test This is a message This is another message bin/kafka-con
5、sole-consumer.sh -zookeeper localhost:2181 -topic test -from-beginning,构建kafka-cluster环境,cp config/server.properties config/server-1.properties cp config/server.properties config/server-2.properties config/server-1.properties: broker.id=1 port=9093 log.dir=/tmp/kafka-logs-1 config/server-2.propertie
6、s: broker.id=2 port=9094 log.dir=/tmp/kafka-logs-2 bin/kafka-server-start.sh config/server-1.properties & bin/kafka-server-start.sh config/server-2.properties &,Kafka-cluster,bin/kafka-topics.sh -describe -zookeeper localhost:2181 -topic my-replicated-topic Topic:my-replicated-topic PartitionCount:1
7、 ReplicationFactor:3 Configs: Topic: my-replicated-topic Partition: 0 Leader: 1 Replicas: 1,2,0 Isr: 1,2,0 bin/kafka-console-producer.sh -broker-list localhost:9092 -topic my-replicated-topic my test message 1 my test message 2 bin/kafka-console-consumer.sh -zookeeper localhost:2181 -from-beginning -topic my-replicated-topic ps | grep server-1.properties 得到PID kill -9 PID bin/kafka-topics.sh -describe -zookeeper localhost:218192 -topic my-replicated-topic bin/kafka-console-consumer.sh -zookeeper localhost:2181 -from-beginning -topic my-replicated-topic,感谢聆听,THANKS,2014/07/04,
