java操作MongoDB存储文件

GridFS是MongoDB为存取大型文档(超过4mb)准备的。首先是关于GridFS原理性的介绍。

一、GridFS原理

This filesystem within MongoDB was designed for … well, holding files, especially files over 4MB … why 4MB?

Well BSON objects are limited to 4MB in size (BSON is the format that MongoDB uses to store it’s database information) so GridFS helps store files across multiple chunks.

As Kristina Chodorow of 10Gen puts it …

GridFS breaks large files into manageable chunks. It saves the chunks to one collection (fs.chunks) and then metadata about the file to another collection (fs.files). When you query for the file, GridFS queries the chunks collection and returns the file one piece at a time.

Why would you want to break large files in to “chunks”? A lot of of comes down to efficient memory & disk usage.

Say you want to store larger files (maybe a 2GB video) when you preform a query on that file all 2GB needs to be loaded into memory … say you have a bigger file, 10GB, 25GB etc … it’s quite likely you’d run out of usable RAM or not have that much RAM available at all!

So, GridFS solves this problem by streaming the data back (in chunks) to the client … this way you’d never need to use more than 4MB of RAM.

二、命令行方式操作

在MongoDB的安装目录下有个mongoFiles.exe这就是用来存取文件的。

存储之后,发现这个文件被存在了testDatabase的fs.files集合下。利用testDatabase.fs.files.find("mylove.wma")可以查询到此文档。

三、java方式存储

复制代码
View Code
 1 import java.io.File;  
2 import java.net.UnknownHostException;
3 import java.util.Date;
4 import java.util.List;
5 import com.mongodb.BasicDBObject;
6 import com.mongodb.DB;
7 import com.mongodb.DBCollection;
8 import com.mongodb.DBCursor;
9 import com.mongodb.DBObject;
10 import com.mongodb.Mongo;
11 import com.mongodb.MongoException;
12 import com.mongodb.gridfs.GridFS;
13 import com.mongodb.gridfs.GridFSInputFile;
14
15 public class MongoDBClientTest {
16
17 public static void main(String[] args) {
18 // initData();
19 // query();
20 initData4GridFS();
21 }
22
23
24 private static void initData4GridFS() {
25 long start = new Date().getTime();
26 try {
27 Mongo db = new Mongo("127.0.0.1", 50000);
28 DB mydb = db.getDB("wlb");
29 File f = new File("D://study//document//MySQL5.1参考手册.chm");
30 GridFS myFS = new GridFS(mydb);
31 GridFSInputFile inputFile = myFS.createFile(f);
32 inputFile.save();
33
34 DBCursor cursor = myFS.getFileList();
35 while(cursor.hasNext()){
36 System.out.println(cursor.next());
37 }
38 db.close();
39 long endTime = new Date().getTime();
40 System.out.println(endTime - start);
41 System.out.println((endTime - start) / 10000000);
42 }catch (Exception e) {
43 e.printStackTrace();
44 }
45 }
46 }
复制代码

四、参考博客

1、http://learnmongo.com/posts/getting-started-with-mongodb-gridfs/

2、http://blog.csdn.net/zhangzhaokun/article/details/6287309

 

posted @   明之道  阅读(10659)  评论(2编辑  收藏  举报
编辑推荐:
· 如何编写易于单元测试的代码
· 10年+ .NET Coder 心语,封装的思维:从隐藏、稳定开始理解其本质意义
· .NET Core 中如何实现缓存的预热?
· 从 HTTP 原因短语缺失研究 HTTP/2 和 HTTP/3 的设计差异
· AI与.NET技术实操系列:向量存储与相似性搜索在 .NET 中的实现
阅读排行:
· 周边上新:园子的第一款马克杯温暖上架
· Open-Sora 2.0 重磅开源!
· .NET周刊【3月第1期 2025-03-02】
· 分享 3 个 .NET 开源的文件压缩处理库,助力快速实现文件压缩解压功能!
· [AI/GPT/综述] AI Agent的设计模式综述
点击右上角即可分享
微信分享提示