IBM Informix dynamic server 11 10 Cheetah Sql Features

New Application Development features in IDS 11.10. Keshava Murthy, Architect, Informix Development [email_address]

SQL Features in IDS v11 Language features Full support for subqueries in FROM clause Optimizer features Index self-join access method Utility Features sysdbopen()/sysdbclose() ADD_MONTHS(), ASCII(), etc., functions New Types and Indices. Node datatype Basic Text Search Index Stored Procedure Enhancements GO TO and LOOP statements XML Support

Language Features Full support for subqueries in FROM Clause Enhancements to distributed queries Trigger Enhancements

Support For Subqueries in FROM Clause SELECT * FROM (SELECT tab1.a, tab2.x, tab2.y FROM tab1, tab2 WHERE tab1.a = tab2.z ORDER BY tab1.b ) vt(va, vb, vc), emptab WHERE vt.va = emptab.id; SELECT * FROM ((SELECT c1,c2 FROM t3) AS vt3(v31,v32) LEFT OUTER JOIN ((SELECT c1,c2 FROM t1) AS vt1(vc1,vc2) LEFT OUTER JOIN (SELECT c1,c2 FROM t2) AS vt2(vc3,vc4) ON vt1.vc1 = vt2.vc3) ON vt3.v31 = vt2.vc3); SELECT * FROM table(foo(5)) AS vt(a), tab1 t WHERE vt.a = t.x;

Enhancements to Distributed Queries Application IDS Server: lenexa Database: geardb Table: winter_gear with Boolean, lvarchar and distinct types C, SPL, Java functions IDS Server: portland Database:geardb Table: rain_gear with Boolean, lvarchar, and distinct types C, SPL, Java functions IDS Server: menlo Database: geardb Table: winter_gear with Boolean, lvarchar and distinct types C, SPL, Java functions ISTAR: Distributed query connections SQL and result set exchange Multiple IDS server setup IDS Server: toronto Database:geardb C, SPL, Java functions

Trigger Enhancements employee_tab Insert trigger Delete trigger employee_tab Pre 11.10 server 11.10 server Single insert and delete triggers, and multiple update and select triggers on mutually exclusive columns Multiple insert, update, delete and select triggers without exclusivity rule. The multiple insert and delete triggers feature is new in Cheetah. Update triggers Insert triggers Delete triggers Update triggers Select triggers New Feature: Multiple Triggers New feature: No column Exclusivity rule Select triggers

Optimizer Features Index Self-join Access method Optimizer directives for ANSI joins Improvements to IDS statistics collection Explain enhancements Dynamic explain enhancements Refresher features Subquery flattening View folding More on IDS Redbook

Index Self-Join Access Method SELECT * FROM tab WHERE c1 >= 1 AND c1 <= 3 AND c2 >= 10 AND c2 <= 11 AND c3 >= 100 AND c3 <= 102; leafpage leafpage leafpage leafpage leafpage leafpage leafpage Root View of the index on (c1, c2, c3) Leaf level

Prior Releases Lower Filter c1 >= 1 Upper Filter c1 <= 3 Index Scan Region Eliminated range on c1

With This Feature Lead Keys: c1, c2 Lower Filter c1 = c1 and c2 = c2 and c3 >= 100 Upper Filter c3 <= 102 Index Scan Regions Regions eliminated by Index Self Join strategy

Optimizer Directives for ANSI Joins Previously ANSI join queries allowed EXPLAIN, AVOID_EXECUTE and FIRST_ROWS/ALL_ROWS IDS v11 Adds Access method directives: FULL, INDEX.. Join method directives: USE_HASH, USE_NL.. Join Order directive: ORDERED SELECT --+ FULL(t2), INDEX(t1, t1i1), ORDERED * FROM t1 LEFT OUTER JOIN t2 ON (t1.c1=t2.c1 AND t1.c1=2) WHERE t2.c1 IS NOT NULL DIRECTIVES FOLLOWED: FULL ( t2 ) INDEX ( t1 t1i1 ) ORDERED DIRECTIVES NOT FOLLOWED: Estimated Cost: 7 Estimated # of Rows Returned: 1 ...

Improvements to IDS Statistics Collection Automatic creation of distribution on leading key of the index Implicit UPDATE STATISTICS LOW SAMPLING SIZE UPDATE STATISTICS MEDIUM FOR TABLE tab(c1, c2) SAMPLING SIZE 500 RESOLUTION 2; UPDATE STATISTICS MEDIUM FOR TABLE tab(c1, c2) SAMPLING SIZE .2 RESOLUTION 2; Additional info in sysdistrib

Explain Enhancements Explain enhancements Query Optimization Time Distributed query support Estimated and Actual cardinalities Controlled by EXPLAIN_STAT Dynamic explain enhancements Prints the location the explain file in online.log Provides any errors while trying to create the file onmode –Y <sid> 0|1|2 [filename] Specify the location of the dynamic explain Specify whether you need query stats

Utility Features New Isolation level: Committed Read Last Committed Websphere MQ Messaging support Automatic repreparation of SQL statements Named Parameters support for JDBC New functions and expressions Disabling logging for temporary tables. SYSDBOPEN() and SYSDBCLOSE() procedures

Committed Read Last Committed -- do more -- do more --will return 850.00 -- do more -- do more -- Status: lock wait Commit work; -- Continue processing -- Continue processing -- Status: lock wait insert into daily_tab(“transfer”, 1234, 3456, 400); select balance from cust_tab where custid = 1234; -- No waiting -- will return 1250.00 select balance from cust_tab where custid = 1234; -- No waiting. will return 850.00. select balance from cust_tab where custid = 1234; -- wait for the lock on row for customer 1234 update cust_tab set balance = balance + 400 where cust_id = 3456; -- balance of customer 1234 is 850.00 begin work; begin work; begin work; update cust_tab set balance =balance – 400 where cust_id = 1234; begin work; set isolation to read committed; -- Current balance of customer 1234 is 1250.00 Transaction4 LAST COMMITTED (New in IDS 11.10) Transaction3 DIRTY READ Transaction2 COMMITTED READ (default in logged database) Transaction1 Event

Committed Read Last Committed S3:reconstruct 1234 1250 customerid balance S1: start a transaction 1234 850 S1:Withdraw $400 Lock the record and create Log for subtractting 400. 1234 850 S1:Read the updated record S2: committed read: RequestRead the record being updated Result: lock error or wait, if requested S3: Dirty Read request Result: The value returned is time sensitive. Wait for the update to complete and then return 850 S4: Last committed read Result: Recognizes the lock on the row. Goes to the log, returns the old row [1234, 1250] Last Committed Read, Visually

Websphere MQ Messaging Support MQI Connection Queue1 Websphere MQ Informix Dynamic Server Order Entry Application Queue2 Shipping Application MQ Functions and MQ VTI table.

Automatic Re-Preparation of SQL The dreaded -710 error Make -710 disappear fetch open cursor -- IDS 10 used to raise -710 error. IDS 11.10 automatically re-prepares and gets new plan for this and subsequent execution. do something else -- continuing with create index close -- continuing with create index fetch CREATE INDEX ONLINE icln ON customers(lname) fetch fetch open cursor; declare cusor on s1; -- creates and uses the FirstPlan below. Prepare the statement s1; Session2 Session1

Named Parameters Support for JDBC This is an example of implicit positional binding: CallableStatement cstmt = con.prepareCall("call order_item(?, ?, ?, ?, ?,?, ?)"); // Set parameters (positional notation) cstmt.setInt( 1 , 5739 ); cstmt.setInt( 2 , 8294); cstmt.setString( 6 , "345, University ave."); cstmt.setInt( 7 , 94303); cstmt.setString( 4 ,"4100 Bohannon Dr."); cstmt.setInt( 5 , 94025); cstmt.setInt( 3 ,5); // Execute cstmt.execute();

Named Parameters Support for JDBC Here is the same code rewritten using named parameter notation: // Set parameters (named notation) cstmt.setInt(" cust_id ", 5739 ); Chapter 9. SQL Language 275 cstmt.setInt(" item_id ", 8294); cstmt.setString(" shipping_addr ", "345, University ave."); cstmt.setInt(" shipping_zip ", 94303); cstmt.setString(" billing_addr ","4100 Bohannon Dr."); cstmt.setInt(" billing_zip ", 94025); cstmt.setInt(" count ", 5); // Execute cstmt.execute();

New Functions and Expressions ASCII(character_expression) The ASCII function returns the decimal representation of the first character in a character string. ASCII(‘a’) returns: 97 ASCII(‘Hello World!’) returns: 72 ASCII ADD_MONTHS(date/datetime expression , integer ) Adds months to a date or datetime value or expression. The first argument is date or datetime expression and second is an integer. Return type is same as first argument. ADD_MONTHS('4/16/2004', 20) returns: 12/16/2005 ADD_MONTHS(CURRENT, 3) returns: 2007-09-19 10:04:11.00000 ADD_MONTHS()

New Functions and Expressions CEIL (numerical_expession) returns the DECIMAL(32) representation of the smallest integer that is greater than or equal to its single argument. FLOOR(numerical_expression) returns the DECIMAL(32) representation of the largest integer that is smaller than or equal to its single argument. CEIL(-54.232) returns -54 FLOOR(-54.232) returns -55 CEIL(54.232) returns 55 FLOOR(54.232) returns 54 CEIL FLOOR BITAND(num1, num2) – returns the bitwise ANDed value. BITOR(num1, num2) – returns the bitwise ORed value. BITXOR(num1, num2) – returns the bitwise XORed value. BITNOT(num1) – returns the bitwise ANDed value. BITANDNOT(num1, num2) – is a short form for BITAND(arg1, BITNOT(arg2)) Bitwise functions

New Functions and Expressions LAST_DAY(date or datetime expression) Returns last day of the month in the argument. SELECT TODAY AS today, CURRENT AS current, LAST_DAY(TODAY) AS last_from_today, LAST_DAY(CURRENT) AS last_from_current FROM systables WHERE tabid = 1; today 06/19/2007 current 2007-06-19 10:23:01.000 last_from_today 06/30/2007 last_from_current 2007-06-30 10:23:01.00000 LAST_DAY FORMAT_UNITS(number, precision, units) Helps formatting of numbers in kilobytes to peta bytes. Detailed explanation with examples is in IDS SQL Syntax guide. SELECT FORMAT_UNITS( SUM(chksize), 'P') size, FORMAT_UNITS( SUM(nfree), 'p') free FROM syschunks; size 117 MB free 8.05 MB FORMAT_UNITS

New Functions and Expressions MONTHS_BETWEEN(date/datetime expr, date/datetime expr) Returns the difference between two date or datetime expressions in decimal, based on 31day months. SELECT CURRENT, MONTHS_BETWEEN(TODAY, LAST_DAY(CURRENT)) FROM systables WHERE tabid = 1; (expression) (expression) 2007-06-19 10:51:57.000 -0.3694433243728 MONTHS_BETWEEN LTRIM(source_string, pad_string) Returns the source_string after removing specified leading pad characters from a string. LTRIM will remove leading blanks when you simply pass the source string. LTRIM(‘Hello Cheetah!’, ‘Hello ‘) returns: Cheetah! LTRIM

New Functions and Expressions TO_NUMBER(character or numeric expression) converts a number or a character expression representing a number value to a DECIMAL. TO_NUMBER NULLIF(arg1, arg2) Returns NULL if arg1 and arg2 are equal, else returns arg1. If both are NULL – they won’t be equal – but still returns NULL because arg1 is NULL. NULLIF Next_day(date or datetime expr, abbreviated day of the week) Returns the date or datetime for next day matching the second argument. EXECUTE FUNCTION NEXT_DAY(TODAY, 'Mon') returns: 06/25/2007 EXECUTE FUNCTION NEXT_DAY(CURRENT, 'Mon') returns: 2007-06-25 6:57:52.00000 NEXT_DAY

Enhancements to Functions Works same as POW() function. POWER Returns the same value as CURRENT DATETIME year to fraction(5) SYSDATE These two functions can now take date and datetime expressions. IDS Syntax guide explains this in detail. TRUNC ROUND TO_CHAR(numeric expression) In addition to exisiting functionality, in IDS v11.10, this function will convert a number into a charater string. TO_CHAR

Disabling Logging for Temporary Tables Logging on all temporary tables can be disabled by either of the following two ways: ONCONFIG TEMPTAB_NOLOG 1 # 0 (logging on) is the default value. Dynamically onmode -Wf "TEMPTAB_NOLOG=1" onmode -Wm "TEMPTAB_NOLOG=1"

SYSDBOPEN() and SYSDBCLOSE() CREATE PROCEDURE public.sysdbopen (); SET pdqpriority 1; SET ENVIRONMENT OPTCOMPIND '1'; SET ISOLATION COMMITTED READ; SET ENVIRONMENT USELASTCOMMITTED 'ALL'; SYSTEM "echo Logged IN: " || USER || " " || CURRENT || " >> /tmp/mylog"; END PROCEDURE; -- log the entry. CREATE PROCEDURE public.sysdbclose (); SYSTEM "echo Logged OUT: " || USER || " " || CURRENT || " >> /tmp/mylog"; END PROCEDURE;

New Types and Indices Node Data Type Binary Data Type Basic Text Search Index

Node Data Type -- create employees table CREATE TABLE Employees(Employee_Id NODE, desc VARCHAR(60)); -- insert the hierarchical information. INSERT INTO Employees VALUES ('1.0', "CEO"); INSERT INTO Employees VALUES ('1.1', "VP1"); INSERT INTO Employees VALUES ('1.1.1', "Admin for VP1"); INSERT INTO Employees VALUES ('1.2', "VP2"); INSERT INTO Employees VALUES ('1.2.1', "Manager1"); INSERT INTO Employees VALUES ('1.2.2', "Manager2"); INSERT INTO Employees VALUES ('1.2.2.1', "Admin for Manager2"); -- Retrieve the hierarchy for the “Admin for Manager2” SELECT * FROM Employees E WHERE isAncestor(Employee_Id, '1.2.2.1') ORDER BY E.Employee_Id ; employee_id desc 1.0 CEO 1.2 VP2 1.2.2 Manager2

Node Functions Equals NotEqual LessThan LessThanOrEqual GreaterThan GreaterThanOrEqual Compare Increment Length Depth NewLevel GetParent IsParent IsChild Ancestors Graft IsDecendant GetMember

Binary Data Type BINARY18 and BINARYVAR CREATE TABLE bin18_test (int_col INTEGER, bdt_col BINARY18); INSERT INTO bin18_test VALUES (0, '0102'); INSERT INTO bin18_test VALUES (1, '01020304'); CREATE INDEX idx_bin18 ON bin18_test(bdt_col); CREATE INDEX idx_binvar ON bindata(bin_col); Functions on binary types Length() Octet_length() Bit_and() Bit_or() Bit_xor() Bit_complement()

Basic Text Search Index Invocation of LUCENE for text index operations IDS Client IDS Client BTS: Basic Text Search Index Interface Informix Dynamic Server C-LUCENE text search index analyze and arts behavior cut … with your 0, 8, 12, 15 1, 9, 15, 22, 44, 23, 1, 8, 10 1 2, 22 … … … Index Access method Query processing and Optimizer

Basic Text Search Index mkdir /work/myapp/bts_expspace_directory -- Create an external space to hold the index onspaces -c -x bts_extspace -l /work/myappbts_expspace_directory onmode –p +1 bts --Create a table with a BTS index CREATE TABLE article_tab(id integer, title lvarchar(512)); -- Load the data below Informix and Open source: database defense against the dark political arts 1 Understanding locking behavior and analyze lock conflicts in IDS 0 title id

Basic Text Search Index CREATE INDEX title_index ON article_tab(title bts_lvarchar_ops ) USING bts IN bts_extspace; SELECT id FROM article_tab WHERE bts_contains(title, 'informix'); -- with the AND Boolean operator (&& and + are allowed as well) SELECT id FROM article_tab WHERE bts_contains (title, 'informix AND dynamic'); SELECT id FROM article_tab WHERE bts_contains (title, 'inf*rmix'); SELECT id FROM article_tab WHERE bts_contains (title,'"java"~10');

Stored Procedure Enhancements GO TO Statement LOOP Statement Stored procedure recompilation

GO TO Statement CREATE PROCEDURE simple_goto(a int) RETURNS int; IF a < 50 THEN GOTO lessval; -- jump to lessval. END IF; RETURN a * a; -- return something <<lessval>> -- define the label lessval RETURN a * -1; END PROCEDURE;

LOOP Statement CREATE PROCEDURE plusnum(a int) RETURNS int; DEFINE x int; LET x = a; LOOP -- start the loop LET x = x + 1; IF x < 0 THEN CONTINUE; -- increment until +ve number. ELIF x < 1000 THEN RETURN x WITH RESUME; -- return and come back. END IF; EXIT LOOP WHEN x = 1000; -- exit loop at 1000. END LOOP; END PROCEDURE;

LOOP Statement CREATE PROCEDURE sumto_a(a int) RETURNS int; DEFINE x int; DEFINE total int; LET total = 0; FOR x IN (1 TO a) LOOP -- start the loop LET total = total + x; END LOOP; END PROCEDURE;

LOOP Statement CREATE PROCEDURE facto(a int) RETURNS int AS x, int AS factx; DEFINE x,y, factx int; DEFING total int; LET total = 0; LET x = 1; <<main_loop>> WHILE (x <= a) LOOP -- start the loop LET factx = 1; <<facto_loop>> FOR y IN (1 TO x) LOOP -- Abruptly stop at 10 EXIT main_loop WHEN x = 10; LET factx = factx * y; END LOOP facto_loop; RETURN x, factx WITH RESUME; LET X = x+1; END LOOP main_loop; END PROCEDURE;

Stored Procedure Recompilation This is in 10.00.xC7 and 11.10.xC2 Wells Fargo situation -211 error: Cannot read system catalog sysprocplan Happens after altering the table or creating/dropping indices. Also happens if you lock procedure plans when you UPDATE STATISTICS for procedures within BEGIN– COMMIT. Automatic Recompilation Automatically recognize and recompile the required statements Write back the plan in a separate transaction so the locks are release. Automatically available. Nothing for applications to do.

XML Support XML Publishing functions Genxml Genxmlelem Genxmlschema Genxmlquery genxmlqueryhdr XPath Support Extract ExtractValue ExistsNode IDSXMLParse() function

XML Publishing UDR invoking the XSLT4C and XML4C libraries within IDS IDS Client IDS Client Extract functions extract() extracevalue() existsnode() idsXMLParse() genxml functions genxml() genxmlelem() genxmlqueryhdr() XSLT4C Processor XML4C Parser ICU Informix Dynamic Server XSLT4C and XML4C

XML Publishing functions SELECT genxml( ROW(customer_num, fname, lname, address1, city, state, zipcode, phone), 'customer' ) FROM customer WHERE customer_num < 105; genxml < customer customer_num="101" fname="Ludwig " lname="Pauli " company="All Sports Supplies " address1="213 Erstwild Court " city="Sunnyvale " state="CA" zipcode="94086" phone="408-789-8075"/> < customer customer_num="102" fname="Carole " lname="Sadler " company="Sports Spot " address1="785 Geary St " city="San Francisco " state="CA" zipcode="94117" phone="415-822-1289"/> < customer customer_num="103" fname="Philip " lname="Currie " company="Phil's Sports " address1="654 Poplar " address2="P. O. Box 3498 " city="Palo Alto " state="CA" zipcode="94303" phone="415-328-4543"/> < customer customer_num="104" fname="Anthony " lname="Higgins " company="Play Ball! " address1="East Shopping Cntr. " address2="422 Bay Road " city="Redwood City " state="CA" zipcode ="94026" phone="415-368-1100"/> 1 row(s) retrieved.

XML Publishing functions EXECUTE FUNCTION genxmlqueryhdr('manufact_set', 'SELECT * FROM manufact'); (expression) <?xml version="1.0" encoding="en_US.819" ?> <xs:schema xmlns:xs="http://www.w3.org/2001/XMLSchema"> <manufact_set> <row> <manu_code>SMT</manu_code> <manu_name>Smith </manu_name> <lead_time> 3</lead_time> </row> ...

XPath Support SELECT extract(booklist, '/bookstore/book[1]') FROM books WHERE bookstore_id =1234; (expression) <book category="COOKING"> <title lang="en">Everyday Italian</title> <author>Giada De Laurentiis</author> <year>2005</year> <price>30.00</price> </book> SELECT extractvalue(booklist, '/bookstore/book[last()]') FROM books where bookstore_id =1234; (expression) Learning XML Erik T. Ray 2003 39.95 SELECT docid FROM books WHERE existsnode(booklist, '/bookstore/book[author="Kurt Cagle"]/title') = 1 AND bookstore_id =1234; docid 1

Resources Infocentre http://publib.boulder.ibm.com/infocenter/idshelp/v111/index.jsp IDS v11 Redbook http://www.redbooks.ibm.com/abstracts/sg247465.html Keshava Murthy rkeshav@us.ibm.com Thank You

IBM Informix dynamic server 11 10 Cheetah Sql Features

More Related Content

What's hot (19)

Similar to IBM Informix dynamic server 11 10 Cheetah Sql Features (20)

More from Keshav Murthy (20)

Recently uploaded (20)

IBM Informix dynamic server 11 10 Cheetah Sql Features