atomic file operations
Estelle HAMMACHE
estelle.hammache at st.com
Wed Mar 23 04:39:55 EST 2005
Sergei Sharonov wrote:
> Is a write of 1024 bytes atomic?
> Does it relate to the page size in any way? BTW I am using NAND and the page
> may vary between 512 and 2048 bytes depending on a device.
No write operation is guaranteed to be atomic. Have a look
at jffs2_write_inode_range in write.c : if there is not enough
space in the current block for the whole data, it may be split
into several chunks. Additionally write ops that overlap a
cache page boundary (not a flash page) are always split at
the page limit.
If you want to have atomic writes, you could:
1) Mandatorily: ensure that your application will not
issue write ops which overlap a page boundary.
You should not tweak the JFFS2 code to write such
overlapping nodes, otherwise you must also tweak
the GC and it gets difficult.
2) Either tweak jffs2_write_inode_range to forbid
splitting data which does not overlap a page boundary
or adjust JFFS2_MIN_DATA_LEN to reserve enough
space (difficult to estimate maybe if you have
compression...).
The above tweaking should ensure that an input buffer
is written to JFFS2 FS as a single CRC-protected
data node.
You should be aware that on NAND flash JFFS2 uses
a (nand flash) page buffer (wbuf.c), which is flushed
only on fsync/sync/umount. So even though your write
ops will be atomic (with above code tweaks),
there is no guarantee that a buffer is effectively
committed to flash when write() returns, because the
end of the data node may remain in the buffer.
If you want that also, you can tweak JFFS2 again
by requiring a wbuf flush after each "atomic write",
or you can have your application call fsync after
each write.
> Is file rename atomic?
See jffs2_rename in dir.c. There are two steps:
make the new hard link, remove the old hard link.
You may end up with two names for the same inode if
there is a powerdown, so no it is not atomic.
See dir.c, file.c, fs.c for other ops. Generally speaking
write_inode_range is not an atomic operation, write_dnode
and write_dirent are atomic ops. The order of operations
in a file-level operation should ensure global atomicity
in most cases. I don't know if there are other file-operations
besides rename which are not atomic.
> Second issue is: How badly these small chunks will affect my mount time?
There have been previous threads about this.
Some people proposed some (application-side) workaround,
you can find it in the archive or maybe someone will point
it to you.
Bye
Estelle
More information about the linux-mtd
mailing list