You are on page 1of 44

IDEA 10.

3
Official Winter UK Release

James Loughlin
Head of Training & Consultancy
AuditWare Systems Ltd
Agenda
• Welcome
• IDEA 10.3 UK Release – New Features and Enhancements
• SmartAnalyzer Apps & Tutorial
• Questions and Answers
• End
Good News – IDEA 10.3 is finally here…...
What’s New in IDEA 10.3

▪ Character Field Stats


▪ Duplicate Key Detection in Visualization
▪ Stratified Random Sampling
▪ Python
▪ IDEAScript Commands and @Functions
▪ Other Enhancements
Field Statistics (Prior to IDEA 10.3)

Field statistics is used to get statistics


on Numeric, Time and Date fields in the
current database.
There were 44 different Field Statistics.
Which for example, can be used to find:
1. Earliest and latest date in a Date
field
2. Average of a Numeric field
3. Transactions on days when
business is closed
New in IDEA 10.3 – Character Field Statistics
In IDEA 10.3, added the ability to Character Field Stats allows users to
generate field stats on Character fields find potential

• Number of Blanks (NumBlanks): Incomplete records


Number of records that contain
Anomalies (e.g., more categories than
blank (empty) values in the specified
what is listed in product catalogue)
Character field
• Number of Categories Deficiencies (e.g., transactions where
(NumCategories): Number of there is no authorizer)
unique categories for the specified
Character
New in IDEA 10.3 – Character Field Statistics
Clicking on the count, drills-down into the data and results can be saved as their own
databases to be used as audit findings.
Summarizing on character fields can be labor intensive - now using Field Stats it's simple in
IDEA 10.3.
New In IDEA 10.3 – Duplicate Key Detection
in Visualizations

Discover tool in Visualization will


show you the first field it detects
with duplicate items as part of the
dashboard it builds for your data.
New In IDEA 10.3 – Duplicate Key Detection
in Visualizations

From the Field Statistics panel, drill-


down to view the specific records.
New In IDEA 10.3 – Duplicate Key Detection
in Visualizations

You can further customise the dashboard


to show information about other fields
with duplicate keys or any other relevant
field statistic.
New In IDEA 10.3 – Duplicate Key Detection
in Visualizations

Not all duplicates are audit issues.


To find the potential issues, IDEA’s Discover uses its audit intelligence to evaluate your data
and look for duplicates that are exceptions rather than the rule. For example, when looking
at transaction data, invoice numbers should not be duplicated while you expect the sales
rep ID to repeat.
New in IDEA 10.3 – Chart Zooming
Zoom in directly from the axis scroll
bar or use your pointer to select an
area within the chart to zoom into
Disproportionate Stratified Random
Sampling
Stratified Random Sampling is unique to IDEA and lets users take a more informed audit
sample that balances materiality with impartiality.
This feature saves time during the sampling process because it allows auditors to break
transactions down into strata before selecting the sample, ensuring the sample is truly
representative of the entire population, considers materiality requirements, and remains
impartially selected.
New in IDEA 10.3 - Proportionate Stratified
Random Sampling
In IDEA 10.3, auditors can
specify the percentage of
records within each stratum,
making the process more
effective when populations and
file sizes vary greatly such as
month to month sales data.
The actual percentage in the
strata may change as IDEA will
snap to the closest whole
number of records for the
sample size.
New in IDEA 10.3 – Python Integration

IDEA 10.3 (Desktop only) now


includes a Python interpreter and
key packages to let you leverage the
power of this tool.
Users can extend the functionality
of IDEA by building their own
advanced analytics or using existing
Python scripts.
New in IDEA 10.3 – Python Integration

• Python installed with IDEA 10.3


• Python must be enabled on your computer (first time only)
• Python environment is launched in the background (hidden)
• IMPORTANT! Python scripts are in one of two locations:
▪ Python scripts used for @Python are in Custom Functions subfolder
▪ Python scripts to run in Macros tab are in Macros subfolder
• Python scripts for @Python are built upon first load of database using them
▪ If you change Python script used in @Python, you must Validate equation or close
and reopen database for changes to take effect
▪ Regular Python scripts may need database or application re-opening

▪ Python scripts need two lines of code to recognize IDEA objects


New in IDEA 10.3 – Python Integration
• To enable Python in IDEA 10.3 on your computer
▪ Check “Run Python scripts” box in Options, then agree to disclaimer
New in IDEA 10.3 – Python Integration

IDEA 10.3 Development Environment

IDE of your choice


IDEAScript Python (3.5.3) (PyCharm, Visual Studio, Eclipse, etc.)

IDEAPythonStarterPack.zip
Python 3.5.3
IDEA’s IDE (no IDE)
(incl. debugger)
Python Package 1 Python Package 1
Python Package 2 Python Package 2
Python Package 3 Python Package 3

IDEA’s COM Objects (DLLs)

(2) Final test, run, use it from IDEA (1) Build it, debug it, test it here
New in IDEA 10.3 – Python Integration

IDEA
• Main script, run this one
Declare classes and globals
<myscript>.py

• Check for errors, dependencies
IDE • Can be run from IDE or IDEA
(PyCharm)

• PAGE generates it initially


<myscript>_dialog_
PAGE <myscript>_dialog.tcl
_support.py • Check for errors, dependencies
• Can be run from IDE or IDEA

<myscript>_dialog.py
New in IDEA 10.3 – Python Integration
New in IDEA 10.3 – Python Integration
New in IDEA 10.3 – Python Integration
New in IDEA 10.3 – Python Integration

Augment your analysis by calling Python


using @Python*.
*A working Python script with this name must exist in the Custom Functions
Library group.
New in IDEA 10.3 - IDEAScript Commands &
@Functions
Belonging to the Client object, this command lets IDEAScript call the Python script of
RunPython
your choice, after which it resumes processing in IDEAScript.

Similar to RunPython, this command lets IDEAScript call the Python script of your choice
RunPythonEx
with multiple parameters. It then resumes processing in IDEAScript.

Similar to StratifyOnBand, this command lets IDEAScript specify the percentage of


StratifyOnBandWithPercent
records to extract for each stratum.

This is a new way for the FieldStats object to report the number of unique categories for
NumCategories
a given Character field.

This command acts as a new way for the Database object to create an instant
NumCategoriesOutputDB
summarization database from the Character Field Stats of a database with field statistics.

This new command lets the FieldStats object report the number of cells with blanks for a
NumBlanks
given Character field.

A new @Function, @Python lets auditors extend IDEA’s existing library of @Functions
@Python
with their own creations written in Python. It is ideal for Virtual fields.
New FieldStatistics indices have been created: “110” for # of Blanks, “111” for # of
@FieldStatistics
Categories.
New in IDEA 10.3 – Other Items

• Windows Server 2016: IDEA and IDEA • Fuzzy Duplicate: Now supported on
Server are now compatible. IDEA Server.
• Microsoft SQL Server 2016: IDEA
Server is now compatible. • Report Reader: We now support
imports of PDF formats listed as PDF/A
• Citrix XenApp: 7.6 and 7.12 now (objects within PDF). Users also now
supported for IDEA and IDEA Server.
have the option to preserve as a text
• UTF-8: IDEA 10.3 automatically detects file when importing a PDF file to IDEA
files with international characters to save time in subsequent imports.
encoded in UTF-8 format, and imports
data correctly without the need to
change the encoding of the source files
before importing into IDEA. This
simplifies the review of international
data for users with operations around
the world.
New in IDEA 10.3 – Other Items

• Improved Indexing Performance: • SmartAnalyzer Enhancements: Many


IDEA’s processing engine has been enhancements included in IDEA 10.3
upgraded, reducing processing time in
many cases, depending on file size, (see What’s New document). Also with
data structure, the nature of data and IDEA 10.3 and SmartAnalyzer App SDK
the hardware being used. 3.2, apps can be generated that are
• CaseWare Working Papers: IDEA can FIPS compliant.
now send Results output to CaseWare
Working Papers 2017
• Send to Excel: Now save Results
outputs to the Results Library group. It
will also support any locally installed
spreadsheet software associated with
the .XLS extension, not just Microsoft
Office.
IDEA 10.3 - Demonstration
IDEA 10.3 – Release Date

Available to purchase, or with a valid maintenance contract, download


TODAY!!
SmartAnalyzer
What is SmartAnalyzer?

SmartAnalyzer is an easy-to-use reporting framework providing a comprehensive pool of predefined


audit tests covering multiple audit areas. SmartAnalyzer is an integrated part of
IDEA and IDEA Server. It comes with every edition of IDEA version 10 and includes by
default five sample audit tests.

SmartAnalyzer is a powerful tool, no matter if you are an experienced auditor or a first


time user. Working with SmartAnalyzer you will benefit from the most efficient way to
run a data analysis. Pre-defined and quality checked audit tests will help you to save time
as you do not have to define your own tests from scratch.
SmartAnalyzer Reporting Framework
SmartAnalyzer Marketplace
SmartAnalyzer Financials Apps

General Ledger Accounts Receivable Accounts Payable

• Out of Balance Journal Entries


• Aging by Due Date and Invoice Date • Aging by AP Invoice Date
• Duplicate Journal Entries • Duplicate Invoices or Payments
• Debtors with Balances Greater than
• Missing Journal Entries • Creditors with Net Debit Balances
Credit Limit
• Journal Entries Posted on Weekends • Creditors with Total Invoice Amount
Journal Entries Posted on Specific Dates • Debtors with Total Amount Greater
• Greater than Approved Limit
Journal Entries Posted at Specific Times than Credit Limit
• • Creditors with Balances Greater than
• Journal Entries by User • Debtors with Net Credit Balances Approved Limit
• Journal Entries by Period and Journal • Debtor Transaction Summary • Creditor Transaction Summary
Source
• Transactions Around a Specified Date • Invoices without Purchase Order
• Journal Entries by Period Numbers
• Journal Entries with Large Amounts
• AR Duplicate Field Search
• Transactions Around a Specified Date
• Journal Entries with Rounded Amounts
• Transactions Posted on Specified
• Journal Entries with Amounts that End in Dates
999
• Journal Entries with Specific Comments • Transactions Posted at Specified
Times
• Summary by Account Number
• Transactions by User ID
• Summary by Account Combinations
• Account Balances by Journal Source • AP Transactions Posted on Weekends
• Account Balances by Period • AP Transactions with Rounded
Amounts
• AP Duplicate Field Search
SmartAnalyzer Financials Apps

Fixed Assets Inventory

• Fixed Assets Additions • Aging by Receipt Date and Ending


• Asset Category Summary • Inventory Balance
• Recalculate Straight Line Depreciation • Aging by Receipt Date and Unit Cost
• Recalculate Declining Balance Depreciation • Recalculate Inventory Balance
• Depreciation Exceeding Cost • Calculate Inventory Turnover Ratio
• Duplicate Field Search • Calculate Unit Turnover Ratio
• Zero or Negative Unit Cost
• Negative Quantity on Hand
• Inventory Location Summary
• Large Inventory Amounts
• Inventory Received Around Specified Date
• Last Sales Price Lower than Unit Cost
• Compare Sales Price with Unit Cost
• Duplicate Field Search
SmartAnalyzer Risk-Based Payroll App

• Different employees, same bank information


• Employees with missing bank information
• Employees over mandatory retirement age
• Duplicate tax ID information
• Employees without PTO
• Employees without benefits deductions
• Low federal/national tax withholding
• Payments after termination
• Manual payroll cheques
• Employees with high overtime pay
• Unusual net pay
• Analysis of unusual hourly rate changes
• Analysis of unusual salary base pay changes
SmartAnalyzer – Other Specific Apps
SAP P2P & O2C Process Mining Apps
The IDEA app Process Mining P2P & O2C uses the process mining technology to dissect and analye the purchase-to-pay
activities of a company. Purchase-to-pay processes are examined, reconstructed and visualized on the basis of SAP® data
to make the actual processes as transparent as possible.

IDEA Banking Apps for Banks and other Financial Institutions:


Account Activity Manager

CaseWare Analytics’ Account Activity Manager provides an easy way to automatically detect errors and possible fraud
schemes involved with deposit accounts. The application uses IDEA® Data Analysis software and includes several tests
that identify control weaknesses by analysing data generated from deposit accounts. Once identified, the application then
reports the exceptions and provides guidelines for remediation.

Loan Examiner
CaseWare Analytics’ Loan Examiner provides an easy way to automatically detect errors and possible fraud schemes
involved with loan accounts. The application uses IDEA® Data Analysis software and includes several tests that identify
control weaknesses by analysing data generated from loan accounts. Once identified, the application then reports the
exceptions and provides guidelines for remediation.
SmartAnalyzer – Other Apps
Duplicate Excluder

Comparing values in the same field, but in different rows is a challenge – especially if you need to not only identify which
data differs, but how it differs. The Duplicate Excluder App uses a comprehensive suite of nine tests to identify duplicates
across rows and refine the difference for one field. This testing process helps filter out false positives that differ
significantly in value. The maximum amount of difference between numbers can be specified to pinpoint potential areas
of interest, anomalies or errors.
The Duplicate Key Exclusion App helps identify records where certain key fields are the same, but the exclusion field is
different. Tests included with this App are:
• Character Differences Due to Transpositions
• Character Differences within a Levenshtein Distance:
• Date Differences within a Range
• Numeric Absolute Differences within a RangeNumeric Absolute Differences within a Range
• Numeric Percentage Differences within a Range
• Opposite Amounts when Absolute Values Remain Constant
• Varying Letters when Numbers Remain Constant
• Varying Letters when Numbers Remain Constant
• Varying Numbers when Letters Remain Constant:
• Varying Special Characters when Alphanumerics Remain Constant
SmartAnalyzer – Other Apps
IS Fraud Tool Kit

The IS Fraud Tool Kit contains various audit tests that enhance the Benford tests found in IDEA along with including
several additional tests looking for number duplication and rounded numbers.
Main app content:
Benford Tests:
• 1st, 2nd, 3rd & 4th digit test
• 1st two digit test
• 1st three digit test
• Last two digit test
Duplication Tests:
• Same-Same-Same test
• Same-Same-Different test
• Number Duplication test
Other tests:
• Relative Size Factor test
• Modulus test
• Mod tax test
SmartAnalyzer – Other Apps
Address Cross Checker

The Address Cross Checker App combines numbers found in street address fields (street address, suite
number, box number, etc.) with the first 5 digits in the address’ zip code to create a numeric address key for
each address record. The address key can then be used to match addresses within a database or between
any two address databases to produce a higher number of true matches. Some fuzzy matches will occur,
such as two addresses on different streets within the same zip code. This mainly occurs in cities where
there is greater uniformity in street layouts. This App utilizes two matching approaches:

• Approach #1: The Visual Connector feature within IDEA performs many-to-many matches. Each
address key record in the first database will be matched to every possible matching address key record
in the second database.
• Approach #2: The Join database feature in IDEA performs a many-to-one match. Each address key
record in the first database will be matched to the first matching address key record encountered in the
second database.

The output database from both matching processes will need to be reviewed to separate the true matching
records from the inadvertent or false positive matches. The Address Cross Checker App is designed to
accommodate up to three separate street address fields and one separate zip code field thus providing
greater flexibility in building your address key.
SmartAnalyzer – Other Apps
Running Total

The Running Total app creates a new RUNNING_TOTAL_X (X being the field you tagged during setup) field
that adds the values of the tagged numeric field one row at a time. It differs from the built-in Control Total
in that it shows you the changes in the total row by row.

IS Multi File Import

The IS Multi File Import allows you to import multiple files into IDEA in just one pass. The application will
handle all the most common IDEA file types such as dBase, Microsoft Access, Microsoft Excel, Print Report,
EBCDIC, Text Fixed Length, Text Delimited and XML.

Excel Export Utility

Easily export multiple IDEA databases into separate worksheets in Excel and automatically name each
sheet.
SmartAnalyzer – Apps in Development
• General Ledger Controls
• Journal Entry Controls
• Accounts Payable Controls
• Procurement Controls
• Accounts Receivable Controls
• Fixed Asset Controls
• Inventory Controls
• Travel & Expense Controls
• Procurement Controls
• Payroll Expenses Controls
• Travel & Expenses Control
Plus more….
SmartAnalyzer Demonstration
SmartAnalyzer Apps SDK
Thank you for your time.

You might also like