summaryrefslogtreecommitdiff
path: root/source4/lib/ldb/ldb_tdb/ldb_index.c
AgeCommit message (Collapse)AuthorFilesLines
2009-07-14remove all '\n' from ldb_debugSumit Bose1-3/+3
2009-06-01use the unique flag on ldb attributes to optimise & clausesAndrew Tridgell1-46/+72
When a attribute is marked unique we know that if we find a match it will be the only possible match. This means that in a list of subtrees connected by an &, it is best to first load the index values for the unique entries, as if they find something then we know we won't have to look any further. This helps with searches like this: (&(objectclass=user)(samaccountname=tridge)) the old code would first have loaded the very large index for the objectclass=user attribute, and then loaded the single entry for samaccountname=tridge. Now we load the samaccountname=tridge entry first, notice that it gives us a single result, and stop, thereby skipping the load of the objectclass=user index record completely.
2009-06-01added support for unique indexing in ldbAndrew Tridgell1-7/+26
When a attribute is marked as LDB_ATTR_FLAG_UNIQUE_INDEX then attempts to add a 2nd record that has the same attribute value for this attribute as another record will fail. This provides a much more efficient mechanism for ensuring that attributes like objectGUID are unique
2009-05-28fixed one-level indexingAndrew Tridgell1-6/+2
one-level indexing was not always effective due to some broken logic in the indexing code. This change means that if normal indexing fails, we can still fall back on one-level indexing. This reduces the number of full unindexed searches in s4 quite a lot
2009-03-09Fix potential segfaults using freed memory.Simo Sorce1-1/+1
In some code paths ltdb_context was still referenced even after we were returned an error by one of the callbacks. Because the interface assumes that once an error is returned the ldb_request may be freed, and because the ltdb_context was allocated as a child of the request, this might cause access to freed memory. Allocate the ltdb_context on ldb, and keep track of what's going on with the request by adding a spy children on it. This way even if the request is freed before the ltdb_callback is called, we will safely free the ctx and just quietly return.
2009-02-23Fix headers, ldb_includes.h is a private header,Simo Sorce1-0/+1
do not reference it from ldb.h
2009-01-30Fix the mess with ldb includes.Simo Sorce1-35/+65
Separate again the public from the private headers. Add a new header specific for modules. Also add service function for modules as now ldb_context and ldb_module are opaque structures for them.
2008-12-19s4:cosmetic: Remove trailing tabs and spacesSimo Sorce1-59/+59
2008-12-19Small cosmetic LDB patch regarding return values.Matthias Dieter Wallnöfer1-4/+4
It changes some "return 0" in "return LDB_SUCCESS"
2008-12-18Rename ldb index pointer wrapper functionAndrew Bartlett1-8/+8
This also asserts that it is used only for index records. Andrew Bartlett
2008-12-17s4:ldb: make it possible to return per entry controlsAndrew Bartlett1-1/+1
Signed-off-by: Stefan Metzmacher <metze@samba.org>
2008-12-17an experimental patch for fixing ldb bloatAndrew Tridgell1-9/+337
ldb indexing can cause huge files, and huge memory usage. This experiment allows us to keep indexes in memory during a transaction, then to write the indexes to disk when the transaction completes. The result is that the db is much smaller (we have seen improvements of about 100x in file size) and memory usage during large transactions is also greatly reduced Note that this patch uses the unusual strategy of putting pointers into a ldb (and thus into a tdb). This works because the pointers are only there during a transaction, so the pointers are not exposed to any other users of the database. The pointers allow us to avoid some really bad allocation problems with tdb record allocation during the re-indexing.
2008-12-16repack the ldb after re-indexingAndrew Tridgell1-0/+4
re-indexing in ldb is triggered on any modification to the @ATTRIBUTES or @INDEXLIST records. This happens to produce a worst-case fragmentation of the database, as all @INDEX records are deleted then re-created. By repacking after re-indexing we ensure that the database ends up without extreme fragmentation.
2008-09-29LDB ASYNC: ldb_tdb backendSimo Sorce1-40/+21
2008-08-22fixed a speellling erraAndrew Tridgell1-1/+1
(This used to be commit 3c058f50cc3b91d540feb51fb698d90565b2b7c9)
2008-04-17use uintptr_t instead of intptr_t where appropriateAndrew Tridgell1-2/+2
(This used to be commit d62f2bcc85c13605c133db250e0a86d2d6ccc481)
2008-01-06r26684: Trivial cleanup from Matthias Dieter Wallnöfer, from bug 5090Andrew Bartlett1-1/+1
Andrew Bartlett (This used to be commit 0016231edd514e8db620bafc44ce877fcac19ed9)
2007-10-10r25218: After discussion with Simo, remove the subclass support from LDB.Andrew Bartlett1-64/+0
Subclass support was designed to avoid needing to spell out the full list of objectClasses that an entry was in. However, Samba4 now enforces this restriction in the objectClass module, and the way subclass matching was handled was complex and counter-intuitive in my opinion (and did not match LDAP). Andrew Bartlett (This used to be commit f5ce04b904e14445a2a7e7f92e7e1f64b645c6f2)
2007-10-10r25000: Fix some more C++ compatibility warnings.Jelmer Vernooij1-6/+6
(This used to be commit 08bb1ef643ab906f1645cf6f32763dc73b1884e4)
2007-10-10r23798: updated old Temple Place FSF addresses to new URLAndrew Tridgell1-2/+1
(This used to be commit 40c0919aaa9c1b14bbaebb95ecce53eb0380fdbb)
2007-10-10r23795: more v2->v3 conversionAndrew Tridgell1-1/+1
(This used to be commit 84b468b2f8f2dffda89593f816e8bc6a8b6d42ac)
2007-10-10r22681: Fix standalone ldb build when parent directory name != ldb.Jelmer Vernooij1-3/+2
(This used to be commit 1093875d59f1ea9b8bd82277d4f9d8366e584952)
2007-10-10r22471: Convert more code to use proper LDB error codes.Simo Sorce1-112/+113
This is a 1 to 1 convertion, next step is to make this code report an error if the basedn is not used, hopefully avoiding an explicit search on the base object in the most common cases. (This used to be commit 50534c84b4577b2d32565a74a4716088f706bfea)
2007-10-10r21311: fix very ugly "using free'ed memory" bugStefan Metzmacher1-1/+1
This was there since 2005... metze (This used to be commit 393e4eeb82df8017eb0afb526f4d723cf8814311)
2007-10-10r20684: if we don't have any indexes, then we should not waste timeStefan Metzmacher1-0/+5
to traverse the whole tdb and unpack each record metze (This used to be commit 492c79de13eab8db6079f880a8f0857dc7a29fa8)
2007-10-10r20184: change ldb_attrib_handler into ldb_schema_attribute, which has a pointerStefan Metzmacher1-3/+3
to a ldb_schema_syntax struct. the default attribute handler is now registered dynamicly as "*" attribute, instead of having its own code path. ldb_schema_attribute's can be added to the ldb_schema given a ldb_schema_syntax struct or the syntax name we may also need to introduce a ldb_schema_matching_rule, and add a pointer to a default ldb_schema_matching_rule in the ldb_schema_syntax. metze (This used to be commit b97b8f5dcbce006f005e53ca79df3330e62f117b)
2007-10-10r20106: Optional ONE Level indexing for ldb_tdbSimo Sorce1-9/+195
To activate it you must modify the @INDEXLIST object adding the attribute @IDXONE: 1 Ldb test included Simo. (This used to be commit ea111795f4016916473ccc05d23c6655e6af1207)
2007-10-10r20101: Also rename a variable now that the unused parameter is goneSimo Sorce1-4/+4
(This used to be commit a2520bcfa918977f2139a963e9817370789cf077)
2007-10-10r20100: Remove completely unused parametersSimo Sorce1-4/+2
(This used to be commit cc1bcb814844e8a03dfa9a310d26ce3f3441e7bb)
2007-10-10r19965: make the output a bit nicerStefan Metzmacher1-2/+3
metze (This used to be commit 8655db41c1e776261ac61a975ca1883b7b59c6aa)
2007-10-10r19964: make debuging easier and report usefull error messagesStefan Metzmacher1-2/+5
metze (This used to be commit f129d78256d965d52e80aedfa76c7c079e611c5f)
2007-10-10r19905: use ldb_dn_new_fmt() to avoid double strdupsSimo Sorce1-14/+3
(This used to be commit 32a6b6c75b041bf829ecf272a9b10164f7ffe12b)
2007-10-10r19884: rename ldb_dn_key -> ltdb_index_key to make more clear what it's for...Stefan Metzmacher1-5/+5
metze (This used to be commit 6b76a7be4ac5443d68a1253dc9ec430dcdc327f1)
2007-10-10r19832: better prototypes for the linearization functions:Simo Sorce1-14/+9
- ldb_dn_get_linearized returns a const string - ldb_dn_alloc_linearized allocs astring with the linearized dn (This used to be commit 3929c086d5d0b3f08b1c4f2f3f9602c3f4a9a4bd)
2007-10-10r19831: Big ldb_dn optimization and interfaces enhancement patchSimo Sorce1-2/+2
This patch changes a lot of the code in ldb_dn.c, and also removes and add a number of manipulation functions around. The aim is to avoid validating a dn if not necessary as the validation code is necessarily slow. This is mainly to speed up internal operations where input is not user generated and so we can assume the DNs need no validation. The code is designed to keep the data as a string if possible. The code is not yet 100% perfect, but pass all the tests so far. A memleak is certainly present, I'll work on that next. Simo. (This used to be commit a580c871d3784602a9cce32d33419e63c8236e63)
2007-10-10r19324: fixed a leak on deleting records when no index is in placeAndrew Tridgell1-6/+6
(This used to be commit 0824b3b8c1003064b0f2c5a3f084f3e711155e8c)
2007-10-10r19114: fixed another checker warning and a possible error on allocationAndrew Tridgell1-1/+3
failure (This used to be commit bc02f7ef96e164a59441e3fd9429221be83fc7e4)
2007-10-10r18439: 2nd try at a talloc_move() api. This type with the ** ptr interfaceAndrew Tridgell1-4/+4
exposed. Unfortunately this generates a large number of type punning warnings. We'll have to find some magic to hide those. (This used to be commit 254cbf09dee5a1e20c47e47a298f1a8d172b41b9)
2007-10-10r18436: converted ldb to use talloc_move() instead of talloc_steal() whenAndrew Tridgell1-4/+4
appropriate. Note that I also removed the error checks that were being done on the result of talloc_steal(). They are pointless as talloc_steal() doesn't have any failure modes that wouldn't cause a segv anyway, and they tend to clutter the code (This used to be commit c0d9e7d473b8e3eb2524a9fc29cf88680f994b36)
2007-10-10r17771: add a comment explaing the odd castAndrew Tridgell1-0/+6
(This used to be commit 47e695ed88d364a7d423e804fe5340006ebf7c18)
2007-10-10r17756: I don't know why but this only works with the standaloneStefan Metzmacher1-3/+3
ldb build...I'll test more tomorrow. metze (This used to be commit aeee1b4655620154a8fefe471ac6327c5ccb8798)
2007-10-10r17748: make the casts much easier to understandStefan Metzmacher1-3/+3
metze (This used to be commit 5992f3b918967ff478ad24333cfe583e0b14a4c9)
2007-10-10r17711: fix compiler warningsStefan Metzmacher1-8/+8
metze (This used to be commit f3dc51fef53287cc2e2af7ed4a9f3f52a5cd06ed)
2007-10-10r17185: Oh, I wanted to do this for sooo long time.Simo Sorce1-6/+6
Finally acknowledge that ldb is inherently async and does not have a dual personality anymore Rename all ldb_async_XXX functions to ldb_XXX except for ldb_async_result, it is now ldb_reply to reflect the real function of this structure. Simo. (This used to be commit 25fc7354049d62efeba17681ef1cdd326bc3f2ef)
2007-10-10r16937: Add const, to make it clear that it is invalid to talloc_free() the DNAndrew Bartlett1-7/+6
at this point. Andrew Bartlett (This used to be commit f7fb168ab69e39ab3ff236bb5db4e5306a79971d)
2007-10-10r14431: don't call qsort with a null arrayAndrew Tridgell1-1/+3
(This used to be commit 2c33f577ad5bf8cddec735e75a26c4a4c07d8c51)
2007-10-10r13818: Make ldb_tdb 'fake' async.Simo Sorce1-47/+59
Simo. (This used to be commit 0db616ef59ed51cac7e0bfaea8a799d5aa42ef16)
2007-10-10r13609: Get in the initial work on making ldb asyncSimo Sorce1-0/+1
Currently only ldb_ildap is async, the plan is to first make all backend support the async calls, and then remove the sync functions from backends and keep the only in the API. Modules will need to be transformed along the way. Simo (This used to be commit 1e2c13b2d52de7c534493dd79a2c0596a3e8c1f5)
2007-10-10r13335: Fix the build and add an utf8 safe ldb_hadler_fold functionSimo Sorce1-1/+1
based on ldb_casefold (This used to be commit 6104f900863c688707809d42c5429a42d654d5fb)
2007-10-10r13333: revert previous commit I will use ldb_caseless_cmp in attrib_handlersSimo Sorce1-1/+1
to correctly support utf8 comparisons add an ldb_attr_Casefold function for attribute names and use it instead of casefold in the right places (This used to be commit 3b4eb2413bbce059dde69f35c03cdc3cc2ba85c5)