C++实现的IO高效的算法TPIE

C++实现的IO高效的算法
类似的有berkeley DB Hash等
TPIE
The data sets involved in some modern applications are too large to fit in the main memory of even the
most powerful computers and must therefore reside on disk. Thus communication between internal and
external memory, and not actual computation time, often becomes the bottleneck in the computation.
This is due to the huge difference in access time of fast internal memory and slower external memory such
as disks. While typical access time of main memory is measured in nanoseconds, a typical access time of
a disk is on the order of milliseconds [20]. So roughly speaking there is a factor of a million difference in
the access time of internal and external memory. A good example of an applications involving massive
amounts of geometric data is NASA’s Earth Observation System (EOS) [29, 42], which is expected to
manipulate petabytes (thousands of terabytes, or millions of gigabytes) of data.
The goal of theoretical work in the area of external memory (EM) algorithms (also called I/O algorithms
or out-of-core algorithms) is to eliminate or minimize the I/O bottleneck through better algorithm
design.
具体的算法地址
http://www.cs.duke.edu/TPIE
http://www.madalgo.au.dk/Trac-tpie
TPIE, a Transparent Parallel I/O Environment, designed to assist programmers
in writing high performance I/O-efficient programs for a variety of platforms.
这个算法对IO进行了抽象,实现了栈、B树等算法
效率的测试方法
http://algo2.iti.kit.edu/dementiev/stxxl/trunk/containers_2berkeley__db__benchmark_8cpp-example.html
posted @   2012  阅读(8637)  评论(0编辑  收藏  举报
编辑推荐:
· Linux glibc自带哈希表的用例及性能测试
· 深入理解 Mybatis 分库分表执行原理
· 如何打造一个高并发系统?
· .NET Core GC压缩(compact_phase)底层原理浅谈
· 现代计算机视觉入门之:什么是图片特征编码
阅读排行:
· 手把手教你在本地部署DeepSeek R1,搭建web-ui ,建议收藏!
· Spring AI + Ollama 实现 deepseek-r1 的API服务和调用
· 数据库服务器 SQL Server 版本升级公告
· 程序员常用高效实用工具推荐,办公效率提升利器!
· C#/.NET/.NET Core技术前沿周刊 | 第 23 期(2025年1.20-1.26)
历史上的今天:
2011-01-17 Reflection.Emit的使用场景、工具包及示例总结
2011-01-17 iOS开发笔记 3、iOS基础
点击右上角即可分享
微信分享提示