Question : SQL QUERY is too Complex

I have attached the full code now. Having progressed some more more myself the three problems I have are really this:-

1)When the query (this is created in VBA as a string) runs for the second time the connection.close does not seem to work and is slow. Furthermore as the query inserts into a particular sheet, there is no record set that I can make = to nothing? to release cache memory.

2)The query itself when it is run with all the parameters (i.e. cost centres and activity codes from the financial systems). this runs into approx 700 variables against which each record is to be checked. This causes the following message to appear, Query to complex and then it debugs out. (It does work with less variables though.

3)Therefore I thought of another method being that why not bring all the records into a record set (scripting dictionary) and use individual vlookups against the parameters to cleans the data. However I believe that the recordset created by the create object "scripting dictionary" only stores upto 37k records, whilst a spreadsheet can store upto 64k records.

Are the limitiations that I have found correct and if so are there any solutions to this problem. I cannot mess about with the memory settings on the machine as they are all standard build and locked down.

Code Snippet:

         
           
             1:
2:
3:
4:
5:
6:
7:
8:
9:
10:
11:
12:
13:
14:
15:
16:
17:
18:
19:

           
           
             Sub rt()
Dim strSQL As String
Set objconnection = CreateObject("ADODB.Connection")
DBQfile = ActiveWorkbook.FullName
Sheets("Sheet1").Activate
DBQsheet = ActiveSheet.Name
objconnection.Open "Provider=Microsoft.jet.OLEDB.4.0;" & _
"Data Source=" & DBQfile & ";" & _
"Extended Properties=""Excel 8.0;HDR=YES;"";"
DBQfile = ActiveWorkbook.FullName
selSQL = "Select * From [" & DBQsheet & "$]where (Number = 2 OR Number = 3 OR Number = 4) AND (Name = 'C' or Name = 'D' OR Name = 'E')"
 
 
strSQL = "INSERT INTO [Sheet2$] IN '" & DBQfile & "' 'Excel 8.0;' " & selSQL
 
MsgBox strSQL
objconnection.Execute strSQL
objconnection.Close
End Sub

           
         

Open in New Window Select All

Answer : SQL QUERY is too Complex

Another approach to this would be to select your data into an adodb recordset then use the CopyFromRecordset method of Excel's range object. This may reduce the complexity. You'
Dim cn as ADODB.Connection ' Early binding is better
Dim rs as ADODB.Recordset
Dim f as ADODB.Field
...
Set cn = ....

rs.Open selSQL, cn

for each f in rs.Fields
.... Assign the field name as the column headings
next f

Dim rng as Range
set rng = [A2]
rng.CopyFromRecordset rs