summaryrefslogtreecommitdiff
path: root/source4/lib/charcnv.c
AgeCommit message (Collapse)AuthorFilesLines
2007-10-10r2552: Character set conversion and string handling updates.Andrew Bartlett1-292/+87
The intial motivation for this commit was to merge in some of the bugfixes present in Samba3's chrcnv and string handling code into Samba4. However, along the way I found a lot of unused functions, and decided to do a bit more... The strlen_m code now does not use a fixed buffer, but more work is needed to finish off other functions in str_util.c. These fixed length buffers hav caused very nasty, hard to chase down bugs at some sites. The strupper_m() function has a strupper_talloc() to replace it (we need to go around and fix more uses, but it's a start). Use of these new functions will avoid bugs where the upper or lowercase version of a string is a different length. I have removed the push_*_allocate functions, which are replaced by calls to push_*_talloc. Likewise, pstring and other 'fixed length' wrappers are removed, where possible. I have removed the first ('base pointer') argument, used by push_ucs2, as the Samba4 way of doing things ensures that this is always on an even boundary anyway. (It was used in only one place, in any case). (This used to be commit dfecb0150627b500cb026b8a4932fe87902ca392)
2007-10-10r2380: nicer error reporting in convert_string()Andrew Tridgell1-6/+9
(This used to be commit 6807d336c2365e4e7f45605d75667dbf05715b34)
2007-10-10r2159: converted samba4 over to UTF-16.Andrew Tridgell1-17/+17
I had previously thought this was unnecessary, as windows doesn't use standards compliant UTF-16, and for filesystem operations treats bytes as UCS-2, but Bjoern Jacke has pointed out to me that this means we don't correctly store extended UTF-16 characters as UTF-8 on disk. This can be seen with (for example) the gothic characters with codepoints above 64k. This commit also adds a LOCAL-ICONV torture test that tests the first 1 million codepoints against the system iconv library, and tests 5 million random UTF-16LE buffers for identical error handling to the system iconv library. the lib/iconv.c changes need backporting to samba3 (This used to be commit 756f28ac95feaa84b42402723d5f7286865c78db)
2007-10-10r2106: try to cope with a wider range of UTF-16 characters when we are usingAndrew Tridgell1-3/+5
an external libiconv library. (This used to be commit 168be7fbd7ae876ded39f73a7835e91b35e67244)
2007-10-10r1196: Remove unused pstring/fstring functions.Andrew Bartlett1-45/+0
Andrew Bartlett (This used to be commit 4f06bf4ab8cc61aec730f84766306119eb976c57)
2007-10-10r934: on ascii strings STR_TERMINATE_ASCII should trigger STR_TERMINATE ↵Andrew Tridgell1-1/+1
behaviour (This used to be commit b7935c96742a3c09ee4bf69f708b19095f497be1)
2007-10-10r831: These functions duplicate the push/pull charcnv interfaces that we useAndrew Bartlett1-83/+0
everywhere else in the Samba code, so remove them for clarity. (ok, so also just never liked the names ;-) Andrew Bartlett (This used to be commit 5f5786ad5ff6cc133a143476e8968b00ed057a62)
2003-12-16added support for big-endian ucs2 strings (as used by big-endianAndrew Tridgell1-0/+1
msrpc). this was easier than I expected! (This used to be commit a0a51af6b746b1f82faaa49d33c17fea9d708fb0)
2003-08-15more fixes from the IRIX compiler (thanks herb!)Andrew Tridgell1-1/+1
(This used to be commit 02d068ba7d81d6db25122144981c63f74ad44025)
2003-08-15fixed some places where we don't brace (flags & STR_UNICODE)Andrew Tridgell1-2/+2
this fixes the samba4 server with ascii clients (This used to be commit c770603ac6c3331a4ac79a650cbbbeb21c778137)
2003-08-13first public release of samba4 codeAndrew Tridgell1-0/+925
(This used to be commit b0510b5428b3461aeb9bbe3cc95f62fc73e2b97f)