Forwarded from hibiscus bank
推荐一个 BLOG 的系列文章。http://www.aaronsw.com/weblog/rawnerve
Forwarded from Y
分享一个资源收集频道：
“程序、设计、工具资源收集 - Collections of materials to review with or just some cool websites.”
@awesome_collection
#awesome #collection
“程序、设计、工具资源收集 - Collections of materials to review with or just some cool websites.”
@awesome_collection
#awesome #collection
Forwarded from Tianzhi Jin
隐私/安全 全套软件 https://prism-break.org/
prism-break.org
Opt out of global data surveillance programs like PRISM, XKeyscore, and Tempora - PRISM Break - PRISM Break
Opt out of global data surveillance programs like PRISM, XKeyscore and Tempora. Help make mass surveillance of entire populations uneconomical! We all have a right to privacy, which you can exercise today by encrypting your communications and ending your…
Forwarded from Deleted Account
Medium
Go: Work-Stealing in Go Scheduler
ℹ️ This article is based on Go 1.13.
Forwarded from Deleted Account
Hi all
in the previous share, we introduced a memory database named scuba.
Today we continue to focus on scuba, paper download link:
https://research.fb.com/wp-content/uploads/2016/11/fast-database-restarts-at-facebook.pdf
In this paper, the author introduces a new memory storage layout to use column-oriented storage for better compression and faster query execution strategies. they reference lots of database design include Dremel Powerdrill etc. (Describe in Section 2.1)
Highlight you need to know in this paper:
1. General query performance of Scuba in real facebook business. (section 1)
2. Why they use heap not directory use Memory Mapping. (before section2)
3. Deploy Architecture. How data load to cluster and why so fast. (at start of section2)
4. How they decide which storage layout to use. (before section4)
5. we advise read the conclusion after reading section1(introduce) to find out which aspect of the database design you interested in.
5.1 how scuba copy data
5.2 how they rollout database version
5.3 describe overhead in recovery from the disk.
Conclude:
This paper describes how scuba in action. Besides the knowledge of how scuba designed, we can also learn about how facebook engineers study and make decisions.
in the previous share, we introduced a memory database named scuba.
Today we continue to focus on scuba, paper download link:
https://research.fb.com/wp-content/uploads/2016/11/fast-database-restarts-at-facebook.pdf
In this paper, the author introduces a new memory storage layout to use column-oriented storage for better compression and faster query execution strategies. they reference lots of database design include Dremel Powerdrill etc. (Describe in Section 2.1)
Highlight you need to know in this paper:
1. General query performance of Scuba in real facebook business. (section 1)
2. Why they use heap not directory use Memory Mapping. (before section2)
3. Deploy Architecture. How data load to cluster and why so fast. (at start of section2)
4. How they decide which storage layout to use. (before section4)
5. we advise read the conclusion after reading section1(introduce) to find out which aspect of the database design you interested in.
5.1 how scuba copy data
5.2 how they rollout database version
5.3 describe overhead in recovery from the disk.
Conclude:
This paper describes how scuba in action. Besides the knowledge of how scuba designed, we can also learn about how facebook engineers study and make decisions.
Forwarded from Jian Huang
YouTube
Distributed Systems in One Lesson by Tim Berglund
Normally simple tasks like running a program or storing and retrieving data become much more complicated when we start to do them on collections of computers, rather than single machines. Distributed systems has become a key architectural concern, and affects…
Forwarded from Deleted Account
Hi all
today we are going to share a new paper about druid.
http://static.druid.io/docs/druid.pdf
It's related to the previous share about scuba.
They are all column-oriented database storage.
Like scuba, The Druid database also has an in-memory data storage strategy.
Highlights:
1. Database module roles. (include Real-time node, Historical Nodes, Broker Nodes, Coordinator Nodes)
2. A complex but very useful time window design for storage "segment" in memory.
3. read data from Kafka and can be query in multiple hundred milliseconds after event happen.
today we are going to share a new paper about druid.
http://static.druid.io/docs/druid.pdf
It's related to the previous share about scuba.
They are all column-oriented database storage.
Like scuba, The Druid database also has an in-memory data storage strategy.
Highlights:
1. Database module roles. (include Real-time node, Historical Nodes, Broker Nodes, Coordinator Nodes)
2. A complex but very useful time window design for storage "segment" in memory.
3. read data from Kafka and can be query in multiple hundred milliseconds after event happen.
Forwarded from Deleted Account
Burning Vocabulary
https://burningvocabulary.com/
https://burningvocabulary.com/
Burning Vocabulary
Learn language vocabulary while surfing the web
Mark and save the words you don't understand, use this for everyday reading.
Forwarded from nanmu42
API返回的JSON太大？
Nginx又没法压缩Transfer-Encoding为chunked的返回？
新挖了一个坑，欢迎各位使用和提各种建议：
https://github.com/nanmu42/gzip
适用于Gin和net/http的gzip中间件：基于 Content-Type、Content-Length、扩展名等要素自动判断是否启用压缩。
Nginx又没法压缩Transfer-Encoding为chunked的返回？
新挖了一个坑，欢迎各位使用和提各种建议：
https://github.com/nanmu42/gzip
适用于Gin和net/http的gzip中间件：基于 Content-Type、Content-Length、扩展名等要素自动判断是否启用压缩。
GitHub
GitHub - nanmu42/gzip: :floppy_disk: Golang gzip middleware for Gin and net/http | Golang gzip中间件，支持Gin和net/http，开箱即用同时可定制
:floppy_disk: Golang gzip middleware for Gin and net/http | Golang gzip中间件，支持Gin和net/http，开箱即用同时可定制 - GitHub - nanmu42/gzip: :floppy_disk: Golang gzip middleware for Gin and net/http | Golang gzip中...