58. The final episode
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
This is the final episode of this podcast.
It includes:
- an explanation - why the podcast is coming to a close.
- snippets from a selection of prior episodes
- a brief introduction to Algorithm Integrity Matters - the new Risk Insights podcast.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
57. Michael Drechnowicz, Head of Internal Audit, TK Elevator
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Embracing Internal Audit Evolution: A Conversation with Michael Drechnowicz, Head of Internal Audit at TK Elevator
In this episode, Michael shares his insights on the evolution of IA in his role as Head of Internal Audit with a major player in the global elevator and escalator industry.
His work demonstrates a shift from traditional finance-focus towards extensive business process coverage, ranging from sales to purchasing and fraud investigations.
We discuss the increasing importance of diversity in global audit teams and how technology, particularly Artificial Intelligence (AI) and data analytics, are transforming internal audit processes.
The conversation further touches on AI's importance in identifying and managing risks, improving process efficiency, and augmenting the learning experiences of junior auditors.
Looking ahead, Michael sees a promising and dynamic future for internal auditors amidst rapid digital transformation.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
56. Cathy O'Neil, Algorithm Auditor, Author of WMathD
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Our guest is Cathy O'Neil, author of Weapons of Math Destruction: how big data increases inequality and threatens democracy.
Cathy joined us to discuss critical aspects for auditors to consider, including:
- The human element: why understanding 'for whom an algorithm might fail' is more important than the detailed technical design of an algorithm.
- Algorithm testing: the importance of post-deployment testing to ensure there are no unintended adverse outcomes.
- Setting standards: the need for industry-wide standards so that regulators can ensure there is no bias or discrimination in how algorithms operate.
- Laggers and leaders: the four big industries/domains using algorithms that need to step up audit in their space and how law-makers and regulators are catching up.
- Emerging AI, e.g. language models/chatbots - why trust by users is key, and the pros and cons of using these models.
Links
- Cathy's company, ORCAA
- Weapons of Math Destruction (book)
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
55. Data Science and KNIME with Maarit Widmann
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Maarit Widmann is a data scientist at KNIME (www.knime.com)
In this episode, we discuss:
- What KNIME is
- Why the visual programming paradigm (workflows, rather than code) is appealing to both technical and non-technical professionals
- The most challenging aspects of the data science lifecycle, and what auditors should be aware of
- The most important aspects of the data science lifecycle
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
54. Analysis
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In this episode we discuss the use of the word "analysis" in the context of using data for audits.
This is an attempt to define the "analysis phase" - or stop using it as the name of a phase - so that we can better structure our work.
This is explored in more depth in our book, here: https://riskinsights.com.au/the-data-confident-internal-auditor
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
53. The Data-Confident Internal Auditor
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
This episode is a pre-recorded interview with Benji Block for the Author Hour podcast. We discuss our new book, The Data-Confident Internal Auditor.
For internal auditors, developing trends in data analysis and data science can feel less like a wealth of information and more like an avalanche. Still, better use of data provides an opportunity to advance your career by adopting new invaluable skills.
The missing link: jargon-free guidance that cuts through the hype. The Data-Confident Internal Auditor demystifies the use of data in internal audits through practical step-by-step guidance. With concepts and tools that are easy to understand and apply, this comprehensive guide shows you how to approach data yourself without having to wait on a data scientist or a technical expert.
Developed over the course of hundreds of actual audits, these real-world approaches and practices are distilled into a simple sequence of steps that will leave you feeling confident and even eager to apply them for yourself.
Links:
- The Data-Confident Internal Auditor on Amazon (https://geni.us/DataConfidentInternal)
- The Data-Confident Internal Auditor site - with bonus resources (http://data-confident.com/)
- The original episode on Author Hour (https://authorhour.co/the-data-confident-internal-auditor-yusuf-moolla-conor-mcgarrity/)
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
52. Simplicity
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In this episode we discuss why and how audit quality is improved when we keep things simple.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
51. Performance Audit Mini-Series #4: Conduct/Fieldwork
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
This is the fourth in a series of episodes that focus on performance auditing.
In this episode, we discuss five suggestions to help improve the conduct (fieldwork / execution) phase.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
50. Performance Audit Mini-Series #3 Planning with data
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
This is the third in a series of episodes that focus on performance auditing.
In this episode, we discuss the benefits of adopting a data focused approach during audit planning.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
49. Performance Audit Mini-Series #2 Work Program Balance
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
This is the second of a series of episodes that focus on performance auditing.
In this episode, we discuss the importance of balance in your work program - covering each of the four objectives:
- Effectiveness
- Efficiency
- Economy
- Compliance
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
48. Performance Audit Mini-Series #1 Forward Work Planning
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
This is the first of a series of episodes that focus on performance auditing.
In this episode, we discuss strategic audit planning (a.k.a. forward work planning).
For internal auditors, this is similar to annual (or equivalent) audit planning.
- Understanding your community / public expectations
- Understanding your elected body / parliamentarians
- Understanding the entities within your audit office's jurisdiction
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
47. Three practical ways to fast-track the data cleansing process
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In this episode we discuss three simple ways to improve the data cleansing process - easier, faster and higher quality.
- Find the optimal data source (e.g., don't use a poorly structured dataset)
- Cleanse iteratively - you may not need all of the fields/columns
- Import iteratively - start with a subset of the data and build on that as needed
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
46. Combining data to create risk indicators for audits and risk monitoring/exploration
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In this episode we discuss the use of risk/performance indicators.
These can be used by audit teams, risk teams and integrity agencies.
For audit teams, they are useful throughout the audit lifecycle - planning / risk assessment, fieldwork / conduct and reporting.
We explore why they are useful, what to do and briefly how to get started.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
45. How ANAO uses data in performance audits - with Xiaoyan Lu and Christine Chalmers
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Christine (performance audit) and Xiaoyan (data analytics) are Directors with ANAO, the Australian National Audit Office.
In this episode we discuss:
- What The Australian National Audit Office (www.anao.gov.au) does
- The five ways ANAO uses data in its performance audits
- How performance audit teams work with the central data team
- Challenges with data preparation
- The benefits of a strong focus on data quality
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
44. ESG and Sustainable Investing with Tiina Landau
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Tiina Landau is an internationally recognized sustainability expert and Certified European Financial Analyst (CEFA). She currently works as Sustainability Manager at Neste Corporation, embedding sustainability considerations into new business models and supply chains.
She has extensive experience as a speaker in media and seminars and also writes a column in the Finnish financial newspaper Kauppalehti.
In this episode, we discuss Tiina's book: Sustainable Investing - Beating the Market with ESG. We also explore how internal auditors can help their organizations navigate ESG risks and opportunities.
Links:
- Tiina's book: Sustainable Investing - Beating the Market with ESG (www.palgrave.com/gp/book/9783030714888)
- Tiina on LinkedIn (www.linkedin.com/in/tiinalandau/)
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
43. Microsoft 365 Compliance with Erica Toelle
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Erica Toelle is a senior product marketing manager on the Microsoft compliance product team, with focus on information governance and records management.
Erica is a long-time member of the SharePoint and Microsoft 365 community, a former Microsoft MVP, a published author, and a recognized expert in the information governance area.
In this episode, we discuss Erica's book - Microsoft 365 Compliance: A Practical Guide to Managing Risk.
Links:
- Erica's book - Microsoft 365 Compliance: A Practical Guide to Managing Risk (https://www.apress.com/us/book/9781484257777)
- Erica on LinkedIn (https://www.linkedin.com/in/ericatoelle/)
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
42. Michael DeCero, a Data Professional at TDS with an Internal Audit background
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Michael DeCero is an Internal Audit Analytics Manager at TDS, a telecommunications company.
In this episode, Michael explains how he helps his audit team use data.
Links:
- Towards Data Science (www.linkedin.com/company/towards-data-science)
- Michael on LinkedIn (www.linkedin.com/in/michael-decero-39b95b44/)
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
41. Steve Rummel, Senior IA Analytics Manager at CVS Health
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Steve Rummel is a Senior Internal Audit Analytics Manager at CVS Health.
In this episode, Steve explains how he helps his audit team use data.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
40. A CIO/CRO perspective on risk, security and internal audit with Ari Levien
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Ari Levien is an experienced Chief Information Officer who has also played the role of Chief Risk Officer.
In this episode we discuss how a CIO (with an understanding of risk) thinks about security and risk. We also discuss his views of Internal Audit and what good looks like for IA.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
39. Four Quality Assurance Steps - Data in Audit
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In using data for audits, quality assurance of our work is important.
In this episode, we discuss:
1. The four main QA steps
- Technical QA
- Functional QA
- Business QA (validation)
- Audit QA
2. Why we need a QA Plan
This is explored in more depth in our book, here: https://riskinsights.com.au/the-data-confident-internal-auditor
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
38. Why We Should Spend Time Preparing Our Data and Checking Quality
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In this episode, we discuss FIVE major benefits of investing our time in preparing our data and checking its quality.
These include, in reverse order of importance:
1. Exploration during data prep to understand the data
2. Ensure the data is in the right format for analysis
3. Save time by avoiding incorrect conclusions
4. Confidence in the analysis and result
5. Identify important data related improvement opportunities
This is explored in more depth in our book, here: https://riskinsights.com.au/the-data-confident-internal-auditor
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
37. Using data in performance audit with Gemma Diamond and Morag Campsie (Audit Scotland)
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Morag (Senior Manager) and Gemma (Director) are Performance Auditors with Audit Scotland.
In this episode we discuss how they are using data in their audits, their experience in developing Audit Scotland's data capabilities, collaboration with other audit offices and what the future roadmap looks like.
We also discuss their focus on ensuring their reports meet their audience’s needs, and how data visualisations and charts are being used to communicate key messages.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
36. Why the audit objective should drive our use of data
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
In this episode, we discuss why it is important to focus on our audit objective when using data analysis in our audit.
We explore:
- Why a focus on the objective helps us measure success
- Why we should avoid rules based analysis
- How a focus on the objective helps us stay true to our audit mandate
- Cost benefit analysis when we find things that are not related to the audit
- Why a focus on the objective helps us in reporting on data quality or missing data
This is explored in more depth in our book, here: https://riskinsights.com.au/the-data-confident-internal-auditor
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
35. Stephen McAteer, Performance Audit Data Scientist at VAGO
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Stephen leads the data science team within Performance Audit at VAGO, the Victorian Auditor General's Office. We discuss:
- What VAGO does
- Stephen's approach to helping auditors use data
- Why it's important for all performance auditors to have data skills
- How VAGO has used open data to improve transparency
You can reach out to Stephen via LinkedIn (www.linkedin.com/in/smcateer).
Links
- VAGO Audit Report – Measuring and reporting on service delivery with interactive dashboard for exploring Victorian department performance (www.audit.vic.gov.au/report/measuring-and-reporting-service-delivery)
- VAGO Audit Report – Accessibility of Tram Services with interactive map on the accessibility of Melbourne’s tram network (www.audit.vic.gov.au/report/accessibility-tram-services)
- VAGO Audit Report – Council Libraries which uses Data Envelopment Analysis (DEA) to evaluate efficiency (www.audit.vic.gov.au/report/council-libraries)
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
34. Taka Ariga, GAO's Chief Data Scientist & Innovation Lab Director
Auditing with data: for Performance Auditors and Internal Auditors that use (or want to use) data
Taka is the inaugural Chief Data Scientist at the US Government Accountability Office.
He also leads the GAO's Innovation Lab. We discuss:
- What the GAO does
- How data science is helping GAO
- Innovation and experimentation at GAO
- Machine learning assurance
You can reach out to Taka via the GAO website.
About this podcast
The podcast for performance auditors and internal auditors that use (or want to use) data.
Hosted by Conor McGarrity and Yusuf Moolla.
Produced by Risk Insights (riskinsights.com.au).
58. The final episode
44:11
57. Michael Drechnowicz, Head of Internal Audit, TK Elevator
35:06
56. Cathy O'Neil, Algorithm Auditor, Author of WMathD
44:06
55. Data Science and KNIME with Maarit Widmann
20:36
54. Analysis
19:17
53. The Data-Confident Internal Auditor
23:49
52. Simplicity
16:28
51. Performance Audit Mini-Series #4: Conduct/Fieldwork
13:34
50. Performance Audit Mini-Series #3 Planning with data
17:58
49. Performance Audit Mini-Series #2 Work Program Balance
15:55
48. Performance Audit Mini-Series #1 Forward Work Planning
17:59
47. Three practical ways to fast-track the data cleansing process
9:41
46. Combining data to create risk indicators for audits and risk monitoring/exploration
14:52
45. How ANAO uses data in performance audits - with Xiaoyan Lu and Christine Chalmers
19:34
44. ESG and Sustainable Investing with Tiina Landau
28:36
43. Microsoft 365 Compliance with Erica Toelle
24:59
42. Michael DeCero, a Data Professional at TDS with an Internal Audit background
25:58
41. Steve Rummel, Senior IA Analytics Manager at CVS Health
34:35
40. A CIO/CRO perspective on risk, security and internal audit with Ari Levien
25:54
39. Four Quality Assurance Steps - Data in Audit
10:35
38. Why We Should Spend Time Preparing Our Data and Checking Quality
13:00
37. Using data in performance audit with Gemma Diamond and Morag Campsie (Audit Scotland)
36:05
36. Why the audit objective should drive our use of data
20:21
35. Stephen McAteer, Performance Audit Data Scientist at VAGO
33:07
34. Taka Ariga, GAO's Chief Data Scientist & Innovation Lab Director
35:58