12c Cloud Control Repository: How to Modify the Default Retention and Purging Policies for Metric Data? (Doc ID 1405036.1)

To modify the default retention time for the table EM_METRIC_VALUES from 7 partitions to 14 partitions:

1. Use SQL*Plus to connect to the repository database as the SYSMAN user.
2. Check the current value of the retention periods:

select table_name, partitions_retained
from em_int_partitioned_tables
where table_name in ('EM_METRIC_VALUES','EM_METRIC_VALUES_HOURLY','EM_METRIC_VALUES_DAILY');

TABLE_NAME                 PARTITIONS_RETAINED
-------------------------  -------------------
EM_METRIC_VALUES                             7
EM_METRIC_VALUES_HOURLY                     32
EM_METRIC_VALUES_DAILY                      12

3. To modify the default retention time for the table EM_METRIC_VALUES from 7 partitions to 14, execute:

execute gc_interval_partition_mgr.set_retention('SYSMAN', 'EM_METRIC_VALUES', 14);

4. Verify that the retention period has been modified:

select table_name, partitions_retained
from em_int_partitioned_tables
where table_name in ('EM_METRIC_VALUES','EM_METRIC_VALUES_HOURLY','EM_METRIC_VALUES_DAILY');

TABLE_NAME                PARTITIONS_RETAINED
------------------------- -------------------
EM_METRIC_VALUES                           14
EM_METRIC_VALUES_HOURLY                    32
EM_METRIC_VALUES_DAILY                     12
 

Verifying the Partition Maintenance

Login to repository database as the SYSMAN user and execute the below queries:

select count(*) from EM_METRIC_VALUES where collection_time < trunc(sysdate - 7);
select count(*) from EM_METRIC_VALUES_HOURLY where collection_time < trunc(sysdate - 32);
select count(*) from EM_METRIC_VALUES_DAILY where collection_time < add_months(sysdate,-13);
The queries should return 0 rows if the default retention policies are set.


Note: The queries check if there is any data in these tables beyond the default retention periods: 7 days, 32 days, 12 months, respectively. If the retention periods have been modified, then the corresponding numbers should be used.

metric extension

-- 12-AUG-14	12-AUG-14
select min(collection_time), max(collection_time) from sysman.gc$metric_values_latest where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
select * from sysman.gc$metric_values_latest where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
-- 11-JUL-14	11-AUG-14
-- 07-AUG-14	08-SEP-14
select min(collection_time), max(collection_time) from sysman.gc$metric_values_hourly where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
select * from sysman.gc$metric_values_hourly where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
-- 01-JAN-14	11-AUG-14
-- 01-JAN-14	08-SEP-14
select min(collection_time), max(collection_time) from sysman.gc$metric_values_daily where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
select * from sysman.gc$metric_values_daily where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';


desc sysman.gc$metric_values_latest
Name                      Null     Type          
------------------------- -------- ------------- 
ENTITY_TYPE               NOT NULL VARCHAR2(64)  
ENTITY_NAME               NOT NULL VARCHAR2(256) 
TYPE_META_VER             NOT NULL VARCHAR2(8)   
METRIC_GROUP_NAME         NOT NULL VARCHAR2(64)  
METRIC_COLUMN_NAME        NOT NULL VARCHAR2(64)  
COLUMN_TYPE               NOT NULL NUMBER(1)     
COLUMN_INDEX              NOT NULL NUMBER(3)     
DATA_COLUMN_TYPE          NOT NULL NUMBER(2)     
METRIC_GROUP_ID           NOT NULL NUMBER(38)    
METRIC_GROUP_LABEL                 VARCHAR2(64)  
METRIC_GROUP_LABEL_NLSID           VARCHAR2(64)  
METRIC_COLUMN_ID          NOT NULL NUMBER(38)    
METRIC_COLUMN_LABEL                VARCHAR2(64)  
METRIC_COLUMN_LABEL_NLSID          VARCHAR2(64)  
DESCRIPTION                        VARCHAR2(128) 
SHORT_NAME                         VARCHAR2(40)  
UNIT                               VARCHAR2(32)  
IS_FOR_SUMMARY                     NUMBER        
IS_STATEFUL                        NUMBER        
NON_THRESHOLDED_ALERTS             NUMBER        
METRIC_KEY_ID             NOT NULL NUMBER(38)    
KEY_PART_1                NOT NULL VARCHAR2(256) 
KEY_PART_2                NOT NULL VARCHAR2(256) 
KEY_PART_3                NOT NULL VARCHAR2(256) 
KEY_PART_4                NOT NULL VARCHAR2(256) 
KEY_PART_5                NOT NULL VARCHAR2(256) 
KEY_PART_6                NOT NULL VARCHAR2(256) 
KEY_PART_7                NOT NULL VARCHAR2(256) 
COLLECTION_TIME           NOT NULL DATE          
COLLECTION_TIME_UTC                DATE          
VALUE                              NUMBER        


desc sysman.gc$metric_values_hourly
Name                      Null     Type          
------------------------- -------- ------------- 
ENTITY_TYPE               NOT NULL VARCHAR2(64)  
ENTITY_NAME               NOT NULL VARCHAR2(256) 
ENTITY_GUID               NOT NULL RAW(16 BYTE)  
PARENT_ME_TYPE                     VARCHAR2(64)  
PARENT_ME_NAME                     VARCHAR2(256) 
PARENT_ME_GUID            NOT NULL RAW(16 BYTE)  
TYPE_META_VER             NOT NULL VARCHAR2(8)   
METRIC_GROUP_NAME         NOT NULL VARCHAR2(64)  
METRIC_COLUMN_NAME        NOT NULL VARCHAR2(64)  
COLUMN_TYPE               NOT NULL NUMBER(1)     
COLUMN_INDEX              NOT NULL NUMBER(3)     
DATA_COLUMN_TYPE          NOT NULL NUMBER(2)     
METRIC_GROUP_ID           NOT NULL NUMBER(38)    
METRIC_GROUP_LABEL                 VARCHAR2(64)  
METRIC_GROUP_LABEL_NLSID           VARCHAR2(64)  
METRIC_COLUMN_ID          NOT NULL NUMBER(38)    
METRIC_COLUMN_LABEL                VARCHAR2(64)  
METRIC_COLUMN_LABEL_NLSID          VARCHAR2(64)  
DESCRIPTION                        VARCHAR2(128) 
SHORT_NAME                         VARCHAR2(40)  
UNIT                               VARCHAR2(32)  
IS_FOR_SUMMARY                     NUMBER        
IS_STATEFUL                        NUMBER        
NON_THRESHOLDED_ALERTS             NUMBER        
METRIC_KEY_ID             NOT NULL NUMBER(38)    
KEY_PART_1                NOT NULL VARCHAR2(256) 
KEY_PART_2                NOT NULL VARCHAR2(256) 
KEY_PART_3                NOT NULL VARCHAR2(256) 
KEY_PART_4                NOT NULL VARCHAR2(256) 
KEY_PART_5                NOT NULL VARCHAR2(256) 
KEY_PART_6                NOT NULL VARCHAR2(256) 
KEY_PART_7                NOT NULL VARCHAR2(256) 
COLLECTION_TIME           NOT NULL DATE          
COLLECTION_TIME_UTC                DATE          
COUNT_OF_COLLECTIONS      NOT NULL NUMBER(38)    
AVG_VALUE                          NUMBER        
MIN_VALUE                          NUMBER        
MAX_VALUE                          NUMBER        
STDDEV_VALUE                       NUMBER        


desc sysman.gc$metric_values_daily
Name                      Null     Type          
------------------------- -------- ------------- 
ENTITY_TYPE               NOT NULL VARCHAR2(64)  
ENTITY_NAME               NOT NULL VARCHAR2(256) 
ENTITY_GUID               NOT NULL RAW(16 BYTE)  
PARENT_ME_TYPE                     VARCHAR2(64)  
PARENT_ME_NAME                     VARCHAR2(256) 
PARENT_ME_GUID            NOT NULL RAW(16 BYTE)  
TYPE_META_VER             NOT NULL VARCHAR2(8)   
METRIC_GROUP_NAME         NOT NULL VARCHAR2(64)  
METRIC_COLUMN_NAME        NOT NULL VARCHAR2(64)  
COLUMN_TYPE               NOT NULL NUMBER(1)     
COLUMN_INDEX              NOT NULL NUMBER(3)     
DATA_COLUMN_TYPE          NOT NULL NUMBER(2)     
METRIC_GROUP_ID           NOT NULL NUMBER(38)    
METRIC_GROUP_LABEL                 VARCHAR2(64)  
METRIC_GROUP_LABEL_NLSID           VARCHAR2(64)  
METRIC_COLUMN_ID          NOT NULL NUMBER(38)    
METRIC_COLUMN_LABEL                VARCHAR2(64)  
METRIC_COLUMN_LABEL_NLSID          VARCHAR2(64)  
DESCRIPTION                        VARCHAR2(128) 
SHORT_NAME                         VARCHAR2(40)  
UNIT                               VARCHAR2(32)  
IS_FOR_SUMMARY                     NUMBER        
IS_STATEFUL                        NUMBER        
NON_THRESHOLDED_ALERTS             NUMBER        
METRIC_KEY_ID             NOT NULL NUMBER(38)    
KEY_PART_1                NOT NULL VARCHAR2(256) 
KEY_PART_2                NOT NULL VARCHAR2(256) 
KEY_PART_3                NOT NULL VARCHAR2(256) 
KEY_PART_4                NOT NULL VARCHAR2(256) 
KEY_PART_5                NOT NULL VARCHAR2(256) 
KEY_PART_6                NOT NULL VARCHAR2(256) 
KEY_PART_7                NOT NULL VARCHAR2(256) 
COLLECTION_TIME           NOT NULL DATE          
COLLECTION_TIME_UTC                DATE          
COUNT_OF_COLLECTIONS      NOT NULL NUMBER(38)    
AVG_VALUE                          NUMBER        
MIN_VALUE                          NUMBER        
MAX_VALUE                          NUMBER        
STDDEV_VALUE                       NUMBER        

sysman.gc$metric_values_latest, sysman.gc$metric_values_hourly, sysman.gc$metric_values_daily

-- 12-AUG-14	12-AUG-14
select min(collection_time), max(collection_time) from sysman.gc$metric_values_latest where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
select * from sysman.gc$metric_values_latest where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
-- 11-JUL-14	11-AUG-14
-- 07-AUG-14	08-SEP-14
select min(collection_time), max(collection_time) from sysman.gc$metric_values_hourly where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
select * from sysman.gc$metric_values_hourly where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
-- 01-JAN-14	11-AUG-14
-- 01-JAN-14	08-SEP-14
select min(collection_time), max(collection_time) from sysman.gc$metric_values_daily where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';
select * from sysman.gc$metric_values_daily where METRIC_GROUP_NAME = 'ME$CELLSRV_IOPS_ALL' and entity_name like 'x08p%';

Software

Use case

R plugins to Oracle (Oracle R Enterprise  packages)
Oracle - sys.rqScriptCreate, rqRowEval (parallelism applicable to rq.groupEval and rq.rowEval)
BI publisher consumes XML output from sys.rqScriptCreate for graphs
BIP and OBIEE can also execute R scripts and sys.rqScriptCreate

Hadoop - “Technically, Hadoop consists of two key services: reliable data storage using the Hadoop Distributed File  System (HDFS) 
                and high-performance parallel data processing using a technique called MapReduce.”
with R and Hadoop, you can pretty much do everything in R interface

• these are the functions that I used for building the r2project - a regression analysis tool for Oracle workload performance
• these built-in functions are not smart scan offloadable

SQL> r
  1  select name , OFFLOADABLE from v$sqlfn_metadata
  2* where lower(name) like '%reg%'

NAME                           OFF
------------------------------ ---
REGR_SLOPE                     NO
REGR_INTERCEPT                 NO
REGR_COUNT                     NO
REGR_R2                        NO
REGR_AVGX                      NO
REGR_AVGY                      NO
REGR_SXX                       NO
REGR_SYY                       NO
REGR_SXY                       NO
REGEXP_SUBSTR                  YES
REGEXP_INSTR                   YES
REGEXP_REPLACE                 YES
REGEXP_COUNT                   YES

13 rows selected.

• the sys.rqScriptCreate could be part of the Oracle R Enterprise packages that make use of SELECT SQLs and PARALLEL options (on hints/objects) & that's how it utilizes the Exadata offloading

SQL> select name , OFFLOADABLE from v$sqlfn_metadata
  2  where lower(name) like '%rq%';

no rows selected

References

the workflow

Karl Arao
kellyn, question on awr warehouse, so it is recommended to be on a separate database. and on that separate database it requires a separate diag pack license?
so let's say you have a diag and tuning pack on the source... and then you've got to have diag pack on the target awr warehouse?
thanks!
Kellyn Pot'vin
11:09am
Kellyn Pot'vin
No, you're diag pack from source db grants the limited ee license for the awrw
Does that make sense?
Karl Arao
11:09am
Karl Arao
i see
essentially it's free
because source would have diag and tuning pack anyway
Kellyn Pot'vin
11:10am
Kellyn Pot'vin
It took them while to come up with that, but same for em12c omr
Now, if you add anything, rac or data guard, then you have to license that
Karl Arao
11:11am
Karl Arao
yeap which is also the case on omr
Kellyn Pot'vin
11:12am
Kellyn Pot'vin
Exactly
Karl Arao
11:12am
Karl Arao
now, can we add anymore tables on the awr warehouse
let's say i want that to be my longer retention data for my metric extension as well
Kellyn Pot'vin
11:13am
Kellyn Pot'vin
Yes, but no additional partitioning and it may impact patches/upgrades
Karl Arao
11:13am
Karl Arao
sure
Kellyn Pot'vin
11:14am
Kellyn Pot'vin
I wouldn't do triggers or partitions
Views are cool
Karl Arao
11:16am
Karl Arao
we are going to evaluate this soon, just upgraded to r4
Kellyn Pot'vin
11:16am
Kellyn Pot'vin
Otn will post a new article of advance awr usage next week from me
Karl Arao
11:16am
Karl Arao
another question,
on my source i have 12months of data
Kellyn Pot'vin
11:17am
Kellyn Pot'vin
And know exadata team is asking how to incorporate it as part of healthcheck design
Karl Arao
11:17am
Karl Arao
will it ETL that to the warehouse
like 1 shot
Kellyn Pot'vin
11:17am
Kellyn Pot'vin
That is my focus in dev right now
Karl Arao
11:17am
Karl Arao
that's going to be 160GB of data
and with exp warehouse
there's going to be an impact for sure
Kellyn Pot'vin
11:18am
Kellyn Pot'vin
No, it has throttle and will take 2gb file loads in 3hr intervals, oldest snapshots first
Karl Arao
11:18am
Karl Arao
I'm just curious on the etl
what do you mean 3hours intervals ?
2GB to finish in 3hours
Kellyn Pot'vin
11:19am
Kellyn Pot'vin
Tgen go back to 24 hr interval auto after any catchup, same on downtime catchup

* The parallel_max_servers value is capped by processes-15 (this is true for versions prior 11.2.0.2 as well)
* The formula for default value is 
	parallel_max_servers = min( <show parameter processes> -15 , <computed parallel_max_servers> )
* The fudge for processes parameter could be different 
	Adjusting the default value of parameter parallel_max_servers from 160 to 135 due to the value of parameter processes (150) <-- 150-135=15
	Adjusting the default value of parameter parallel_max_servers from 960 to 216 due to the value of parameter processes (300) <-- 300-216=84
* If parallel_max_servers is set to a lower value than processes parameter 
	then parallel_max_servers and parallel_servers_target are the same
* If parallel_max_servers is set to a higher value than processes parameter 
	then parallel_max_servers and parallel_servers_target are the same
	but the formula = min( <show parameter processes> -15 , <computed parallel_max_servers> ) will be applied

-- OLTP
alter system set sga_max_size=18G scope=spfile sid='*';
alter system set sga_target=0 scope=spfile sid='*';
alter system set db_cache_size=10G scope=spfile sid='*';
alter system set shared_pool_size=2G scope=spfile sid='*';
alter system set large_pool_size=4G scope=spfile sid='*';
alter system set java_pool_size=256M scope=spfile sid='*';
alter system set pga_aggregate_target=5G scope=spfile sid='*';

-- DW
alter system set sga_max_size=18G scope=spfile sid='*';
alter system set sga_target=0 scope=spfile sid='*';
alter system set db_cache_size=10G scope=spfile sid='*';
alter system set shared_pool_size=2G scope=spfile sid='*';
alter system set large_pool_size=4G scope=spfile sid='*';
alter system set java_pool_size=256M scope=spfile sid='*';
alter system set pga_aggregate_target=20G scope=spfile sid='*';

hadoop

forecasting

ITIL

Connect as sysdba and run ...

SQL> connect / as sysdba 
SQL>@get_plan_v2(10g).sql

connect / as sysdba 
set long 10000 
set linesize 250 
set trimspool on 
set feedback off 
set serveroutput on 
exec get_plan_v2 ('<plan_name>');

create or replace procedure get_plan_v1 (A_PLAN_NAME IN VARCHAR2) is
  TYPE list_tab IS TABLE OF VARCHAR2(30) INDEX BY BINARY_INTEGER;
  plan_list list_tab;
  cons_grp_list list_tab;

  t    BINARY_INTEGER := 1;

  cursor c_cons_grp is
    select group_or_subplan, type
    from DBA_RSRC_PLAN_DIRECTIVES
    where plan = A_PLAN_NAME;
  cursor c_cons_grp_map (V_CONS_GRP IN VARCHAR2) is
    select attribute, value
    from DBA_RSRC_GROUP_MAPPINGS
    where consumer_group = V_CONS_GRP;
  cursor c_cons_grp_privs (V_CONS_GRP IN VARCHAR2) is
    select grantee, grant_option
    from DBA_RSRC_CONSUMER_GROUP_PRIVS
    where granted_group = V_CONS_GRP;
begin
  dbms_output.put_line ('execute dbms_resource_manager.create_pending_area;');
  dbms_output.put_line ( dbms_metadata.GET_DDL ('RMGR_PLAN',A_PLAN_NAME) );

  plan_list(1) := A_PLAN_NAME;
  for i in 1..plan_list.COUNT loop
   for r_cons_grp in c_cons_grp loop
    if r_cons_grp.type = 'CONSUMER_GROUP'
      then cons_grp_list(t) := r_cons_grp.group_or_subplan;
           t:=t+1;
           dbms_output.put_line ( dbms_metadata.GET_DDL ('RMGR_CONSUMER_GROUP',r_cons_grp.group_or_subplan) );
      elsif r_cons_grp.type = 'PLAN' then
         plan_list(i+1) := r_cons_grp.group_or_subplan;
    end if;
   end loop;  
  end loop;   
 
  for i in 1..plan_list.COUNT loop
    dbms_output.put_line ( dbms_metadata.GET_DEPENDENT_DDL ('RMGR_PLAN_DIRECTIVE',plan_list(i)) );
  end loop;


  -- Consumer group mappings
  for i in 1..cons_grp_list.COUNT loop
    for r_cons_grp_map in c_cons_grp_map(cons_grp_list(i)) loop
      dbms_output.put_line ('execute DBMS_RESOURCE_MANAGER.SET_CONSUMER_GROUP_MAPPING (ATTRIBUTE=>''' || r_cons_grp_map.attribute || ''', VALUE=>''' || r_cons_grp_map.value || ''', CONSUMER_GROUP=>''' || cons_grp_list(i) || ''');');

    end loop;

  end loop;

  -- consumer group privileges
  for i in 1..cons_grp_list.COUNT loop
    for r_cons_grp_privs in c_cons_grp_privs(cons_grp_list(i)) loop
      dbms_output.put_line ('execute DBMS_RESOURCE_MANAGER_PRIVS.GRANT_SWITCH_CONSUMER_GROUP (GRANTEE_NAME=>''' ||  r_cons_grp_privs.grantee || ''', CONSUMER_GROUP=>''' || cons_grp_list(i) || ''', GRANT_OPTION=> ''' || r_cons_grp_privs.grant_option  || ''');');
    end loop;
  end loop;

  dbms_output.put_line ('execute dbms_resource_manager.submit_pending_area;');
end;
/

download and documentation

license

viz types

• treemap http://www.tableausoftware.com/new-features/new-view-types
• bubble chart
• word cloud

connectors

HOWTOs

Videos

$ cat px.sql

/*
SELECT table_name
FROM dict
WHERE table_name LIKE 'V%PQ%'
OR table_name like 'V%PX%';

TABLE_NAME
------------------------------
V$PQ_SESSTAT
V$PQ_SYSSTAT
V$PQ_SLAVE
V$PQ_TQSTAT
V$PX_BUFFER_ADVICE
V$PX_SESSION
V$PX_SESSTAT
V$PX_PROCESS
V$PX_PROCESS_SYSSTAT
*/

col value format 9999999999
-- Script to monitor parallel queries Note 457857.1
-- shows the if a slave is waiting and for what event it waits..
-- This out shows 2 queries. 1 is running with degree 4 and the other with degree 8. Is shows also that all slaves are currently waiting.
col username for a12
col "QC SID" for A6
col "SID" for A6
col "QC/Slave" for A8
col "Req. DOP" for 9999
col "Actual DOP" for 9999
col "Group" for A6
col "Slaveset" for A8
col "Slave INST" for A9
col "QC INST" for A6
set pages 300 lines 300
col wait_event format a30
select
decode(px.qcinst_id,NULL,username,
' - '||lower(substr(pp.SERVER_NAME,
length(pp.SERVER_NAME)-4,4) ) )"Username",
decode(px.qcinst_id,NULL, 'QC', '(Slave)') "QC/Slave" ,
to_char( px.server_group) "Group",
to_char( px.server_set) "SlaveSet",
to_char(s.sid) "SID",
to_char(px.inst_id) "Slave INST",
decode(sw.state,'WAITING', 'WAIT', 'NOT WAIT' ) as STATE,
case  sw.state WHEN 'WAITING' THEN substr(sw.event,1,30) ELSE NULL end as wait_event ,
decode(px.qcinst_id, NULL ,to_char(s.sid) ,px.qcsid) "QC SID",
to_char(px.qcinst_id) "QC INST",
px.req_degree "Req. DOP",
px.degree "Actual DOP",
s.sql_id "SQL_ID"
from gv$px_session px,
gv$session s ,
gv$px_process pp,
gv$session_wait sw
where px.sid=s.sid (+)
and px.serial#=s.serial#(+)
and px.inst_id = s.inst_id(+)
and px.sid = pp.sid (+)
and px.serial#=pp.serial#(+)
and sw.sid = s.sid
and sw.inst_id = s.inst_id
order by
  decode(px.QCINST_ID,  NULL, px.INST_ID,  px.QCINST_ID),
  px.QCSID,
  decode(px.SERVER_GROUP, NULL, 0, px.SERVER_GROUP),
  px.SERVER_SET,
  px.INST_ID
/

-- shows for long running processes what are the slaves do
set pages 300 lines 300
col "Group" for 9999
col "Username" for a12
col "QC/Slave" for A8
col "Slaveset" for A8
col "Slave INST" for A9
col "QC SID" for A6
col "QC INST" for A6
col "operation_name" for A30
col "target" for A30

select
decode(px.qcinst_id,NULL,username,
' - '||lower(substr(pp.SERVER_NAME,
length(pp.SERVER_NAME)-4,4) ) )"Username",
decode(px.qcinst_id,NULL, 'QC', '(Slave)') "QC/Slave" ,
to_char( px.server_set) "SlaveSet",
to_char(px.inst_id) "Slave INST",
substr(opname,1,30)  operation_name,
substr(target,1,30) target,
sofar,
totalwork,
round((sofar/NULLIF(nvl(totalwork,0),0))*100, 2) pct,
units,
start_time,
timestamp,
decode(px.qcinst_id, NULL ,to_char(s.sid) ,px.qcsid) "QC SID",
to_char(px.qcinst_id) "QC INST"
from gv$px_session px,
gv$px_process pp,
gv$session_longops s
where px.sid=s.sid
and px.serial#=s.serial#
and px.inst_id = s.inst_id
and px.sid = pp.sid (+)
and px.serial#=pp.serial#(+)
order by
  decode(px.QCINST_ID,  NULL, px.INST_ID,  px.QCINST_ID),
  px.QCSID,
  decode(px.SERVER_GROUP, NULL, 0, px.SERVER_GROUP),
  px.SERVER_SET,
  px.INST_ID
/

/*
-- What event are the consumer slaves waiting on?
set linesize 150
col "Wait Event" format a30

select s.sql_id,
       px.INST_ID "Inst",
       px.SERVER_GROUP "Group",
       px.SERVER_SET "Set",
       px.DEGREE "Degree",
       px.REQ_DEGREE "Req Degree",
       w.event "Wait Event"
from GV$SESSION s, GV$PX_SESSION px, GV$PROCESS p, GV$SESSION_WAIT w
where s.sid (+) = px.sid and
      s.inst_id (+) = px.inst_id and
      s.sid = w.sid (+) and
      s.inst_id = w.inst_id (+) and
      s.paddr = p.addr (+) and
      s.inst_id = p.inst_id (+)
ORDER BY decode(px.QCINST_ID,  NULL, px.INST_ID,  px.QCINST_ID),
         px.QCSID,
         decode(px.SERVER_GROUP, NULL, 0, px.SERVER_GROUP),
         px.SERVER_SET,
         px.INST_ID;
*/

-- shows for the PX Deq events the processes that are exchange data
set pages 300 lines 300
col wait_event format a30
select
  sw.SID as RCVSID,
  decode(pp.server_name,
         NULL, 'A QC',
         pp.server_name) as RCVR,
  sw.inst_id as RCVRINST,
case  sw.state WHEN 'WAITING' THEN substr(sw.event,1,30) ELSE NULL end as wait_event ,
  decode(bitand(p1, 65535),
         65535, 'QC',
         'P'||to_char(bitand(p1, 65535),'fm000')) as SNDR,
  bitand(p1, 16711680) - 65535 as SNDRINST,
  decode(bitand(p1, 65535),
         65535, ps.qcsid,
         (select
            sid
          from
            gv$px_process
          where
            server_name = 'P'||to_char(bitand(sw.p1, 65535),'fm000') and
            inst_id = bitand(sw.p1, 16711680) - 65535)
        ) as SNDRSID,
   decode(sw.state,'WAITING', 'WAIT', 'NOT WAIT' ) as STATE
from
  gv$session_wait sw,
  gv$px_process pp,
  gv$px_session ps
where
  sw.sid = pp.sid (+) and
  sw.inst_id = pp.inst_id (+) and
  sw.sid = ps.sid (+) and
  sw.inst_id = ps.inst_id (+) and
  p1text  = 'sleeptime/senderid' and
  bitand(p1, 268435456) = 268435456
order by
  decode(ps.QCINST_ID,  NULL, ps.INST_ID,  ps.QCINST_ID),
  ps.QCSID,
  decode(ps.SERVER_GROUP, NULL, 0, ps.SERVER_GROUP),
  ps.SERVER_SET,
  ps.INST_ID
/


SELECT dfo_number, tq_id, server_type, process, num_rows
FROM gV$PQ_TQSTAT ORDER BY dfo_number DESC, tq_id, server_type, process;

col SID format 999999
SELECT QCSID, SID, INST_ID "Inst", SERVER_GROUP "Group", SERVER_SET "Set",
  DEGREE "Degree", REQ_DEGREE "Req Degree"
FROM GV$PX_SESSION ORDER BY QCSID, QCINST_ID, SERVER_GROUP, SERVER_SET;


SELECT * FROM gV$PX_PROCESS order by 1;

col statistic format a50
select * from gV$PX_PROCESS_SYSSTAT order by 1,2;


SELECT INST_ID, NAME, VALUE FROM GV$SYSSTAT
WHERE UPPER (NAME) LIKE '%PARALLEL OPERATIONS%'
OR UPPER (NAME) LIKE '%PARALLELIZED%' OR UPPER (NAME) LIKE '%PX%' order by 1,2;


SELECT px.SID "SID", p.PID, p.SPID "SPID", px.INST_ID "Inst",
       px.SERVER_GROUP "Group", px.SERVER_SET "Set",
       px.DEGREE "Degree", px.REQ_DEGREE "Req Degree", w.event "Wait Event"
FROM GV$SESSION s, GV$PX_SESSION px, GV$PROCESS p, GV$SESSION_WAIT w
WHERE s.sid (+) = px.sid AND s.inst_id (+) = px.inst_id AND
      s.sid = w.sid (+) AND s.inst_id = w.inst_id (+) AND
      s.paddr = p.addr (+) AND s.inst_id = p.inst_id (+)
ORDER BY DECODE(px.QCINST_ID,  NULL, px.INST_ID,  px.QCINST_ID), px.QCSID,
DECODE(px.SERVER_GROUP, NULL, 0, px.SERVER_GROUP), px.SERVER_SET, px.INST_ID;

You can make use of the cell_iops.sh here http://karlarao.wordpress.com/scripts-resources/ to get a characterization of the IOs across the databases on the cell level. This only have to be executed on one of the cells. And that's a per minute detail.



Whenever I need to characterize the IO profile of the databases for IORM config I would:

pull the IO numbers from AWR
pull the awr top events from AWR (this will tell if the DB is IO or CPU bound)
get all these numbers in a consolidated view
then from there depending on priority, criticality, workload type I would decide what makes sense for all of them (percentage allocation and IORM objective)

Whenever I need to evaluate an existing config with IORM already in place I would:

pull the IO numbers from AWR
pull the awr top events and look at the IO latency numbers (IO wait_class)
pull the cell_iops.sh output on the workload periods where I'm seeing some high activity
get all these numbers in a consolidated view
get the different views of IO performance from AWR on all the databases http://goo.gl/YNUCEE
validate the IO capacity of both Flash and Hard disk from the workload numbers of both AWR and CELL data
for per consumer group I would use the "Useful monitoring SQLs" here http://goo.gl/I1mjd
and if that not enough then I would even do a more fine grained latency & IO monitoring using snapper

On the cell_iops.sh I have yet to add the latency by database and consumer group as well as the IORM_MODE, but the methods I've listed above works very well.





-Karl

Command Line Interface Tools
Tabulated Data
Highlighted Data
3D Surface Plot
Animated Data
Instantaneous Values
Bar Graphs
Vector Graphs
Line Graphs
Ternary Plots
Quantized Heat Maps

Part 1 - Ruby and Object-Oriented Design
Part 2 - The Web, SQL, and Databases
Part 3 - ActiveRecord, Basic Rails, and Forms
Part 4 - Authentication and Advanced Rails
Part 5 - Javascript, jQuery, and AJAX
Part 6 - Opus Project, Useful Gems, and APIs

Interesting India company there’s not a lot of players on the area of big data education (online), the company Lynda.com where I’m subscribed to does not have big data courses
And this one estimated to make $3M in FY14
 
http://www.edureka.in/company
http://www.edureka.in/company#media
http://www.edureka.in/hadoop-admin#CourseCurriculum
http://www.edureka.in/big-data-and-hadoop#CourseCurriculum
http://www.edureka.in/data-science#CourseCurriculum

https://www.khanacademy.org/cs
html and CSS http://www.codecademy.com/tracks/web
html dog - html,css,javascript http://htmldog.com/guides/
fundamentals of OOP and javascript http://codecombat.com/ 
ruby on rails http://railsforzombies.org/
http://www.w3fools.com/
https://www.codeschool.com
Dash https://dash.generalassemb.ly/ which is interactive..make a CSS robot! You can also check http://skillcrush.com/