Organizational Network Analysis (ONA) - Practitioner Course Module 2 - Setting up the Survey
description
Transcript of Organizational Network Analysis (ONA) - Practitioner Course Module 2 - Setting up the Survey
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 1
ONA Practitioner CourseModule 2 – ONA Surveys
ONA Practitioner Course
www.optimice.com.au/courses.php
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 2
Week 1-2E-
learning: Introduction to ONA
Week 3Module 1: Scoping
your ONA project
Week 4Module 2: Setting up your ONA
survey
Week 5Module 3: Visualise networks
with NodeXL
Self-paced InstructorPatti Anklam
InstructorCai Kjaer /
Laurie Lock Lee
InstructorMarc Smith
Cai Kjaer / Laurence Lock Lee• Setting up your survey• Working with mailing lists and other
lists• Creating relationship sets and network
questions• Previewing and launching the survey• Tracking progress and downloading
responses
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 3
Traditional data capture
Manual consolidation of data High chance of error Re-work Labour intensive Database or Excel macro expertise
needed SLOW
www.onasurveys.com
Low risk of error Error free export to leading graphing
tools No re-work No special expertise required for
data collection Up to 90% FASTER
Lots of grunt work involved in piping text from the name generator questions into the name interpreter questions and using "display logic" to only show those slots for alters that the respondent chose to fill
out.
The one big downside is that I had to explicitly specify a maximum number of alters and reveal that number to the respondent by listing N slots -- this implicitly suggests that they "should" enter that many names. Additionally, there is a LOT of annoying (but not difficult) custom coding involved in converting
the output into network data format.”
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 4
Flow of survey – from a respondent’s perspective 1
• Email message to respondent• Email addresses comes from
mailing list• Includes hyperlink to survey
• Includes instructions if link for some reason doesn’t work.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 5
Flow of survey – from a respondent’s perspective 2• Number of steps involved
• Landing page• Additional survey introduction
text.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 6
Flow of survey – from a respondent’s perspective 3
• The ‘About you’ section includes questions about the respondent, e.g. demographic
• Not about their relationships!• No technical limit to number of
questions, but you risk poor(er) response rate if you add too many.
• Note: If you can collect this data through other means (e.g. already exist in a corporate directory) then don’t ask. You can add these attributes to a list (covered below).
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 7
Flow of survey – from a respondent’s perspective 4• Name generator question – it’s
objective is to get respondent to think about their relationships in a particular context.
• List of people relevant in this context.
• We refer to this as a ‘Relationship Set’ – In this survey we have provided names which are relevant in a social context.
• Snow ball vs bounded
• Do you want people to be able to add new names?
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 8
Flow of survey – from a respondent’s perspective 5• Relationship Question• These are the one’s which will result in connecting two nodes/vertices
on a map• The strength of the relationship is determined through the rating scale
• This relationship set (‘Social’) is question-centric.
• The next relationship set (‘Work’) is person-centric…let’s see the difference.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 9
Flow of survey – from a respondent’s perspective 6• Name-generator question, but now
choosing people in a different context…’Work’.
• Here the ‘Add people’ option is turned off
• This is called a ‘closed survey’, or mapping a ‘bounded network’
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 10
Flow of survey – from a respondent’s perspective 7• Person-centric layout.• The respondent will complete the
questions for each person selected…then move to next question.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 11
Comparing side-by-side
Question-centric People-centric
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 12
Final step - Asking ‘Wrap Up’ questions
• This is in reality an ‘About you’ question, just positioned at the end of the survey.
8
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 13
Hands-on: Logging on to ONA Surveys
• Log on to ONA Surveys.• Click on the ‘Account’ page to
validate your subscription type and expiry.
• Click ‘Create new survey’ and enter– Survey name– Survey introduction (text that
appears on the landing page)– Thank you text
• You can click ‘Save’, or continue to the ‘About you’ questions by clicking ‘Save / Next Step’.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 14
Create ‘About You’ questions
• Consider the survey design document
• Which questions should you ask to collect data about each respondent, eg.:–Where they work?–Hierarchy?– Time in role?–…etc, etc.
• Question text
• Short name (used when data is exported)
• Answer options• One can be made default• ‘Coding’ text will be exported
• Compulsory or not
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 15
Question Types
Matrix question What is looks like for the respondent
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 16
Positioning questions – start or end of survey
• This is in reality an ‘About you’ question, just positioned at the end of the survey.
• You can choose if the ‘About you’ question appears at the start of the survey or at the end.
• ‘End of survey’ means AFTER the relationship questions
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 17
Hands on: Create questions
• Create 2-3 questions• One should be a matrix question
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 18
Working with questions
• Add a new question• Add introductory
text to a question
• Duplicate, move or delete questions
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 19
Adding relationship questions
• Relationships in different contexts – ‘Relationship sets’
Social
Family
Work
You can choose you map one or multiple
‘relationship sets’
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 20
Adding relationship questions
• Here you create relationship sets, or control existing ones
• Here you set the options for a chosen relationship set:• Name (keep it short…it is
used as the ‘tab’ name for repondents
• Node list – the list of names which you want to present to the respondent
• Add nodes – turn on or off• Name generator question
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 21
Be careful – adding relationship questions
• The coding field must be a number!
• Visualisation tools expect a number (also called a ‘strength of tie’).
• If you use characters the visualization tools will fail.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 22
Hands on: Create a relationship set and add questions
• Think about your design document• What is the business problem you are trying to solve?• The name generator question is very important!– It helps the respondent think about the names relevant for a
particular context– “Who do you draw on when you work on [topic]?”
• Which questions would help surface the relevant relationship patterns?– “How often do you engage with this person?” – Frequency– “How valuable is this interaction for you” – Value
• Create two relationship sets (and therefore two name generator questions)
• Create 2 relationship questions for each relationship set.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 23
Working with lists
• We operate with 2 different kinds of lists–Mailing list (used to email the survey to respondents) applies to the
entire survey• Is defined on the ‘Survey Options’ tab
–Relationship set list (name which appear with name generator question) applies to one or more relationship sets.• Is defined on the ‘Relations’ tab
• Lists can be reused across surveys• Relationship set
list• Mailing list
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 24
Relationship set list
• Decisions to be made–Which names should be on the list?–Which attributes do we have for these?
• They will appear as nodes/vertices on the map, but given that they may not be surveyed we may not be able to color-code by a particular attribute
Work
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 25
Steps to create lists
• Both the mailing and relationship lists are stored in a single spreadsheet
• You can access this list from either:– The ‘Survey options’ tab– The ‘Relationships’ tab
• We will enter via the ‘Survey options’ tab today
• Relationship set list• Mailing list
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 26
Hands on: Create lists
• Click on ‘Survey Options’ tab• Click on ‘Create list’
Note:
You can associate your ONA Surveys account with a Google account and use Googledocs to store your lists
Today we will be using the ‘Create from template’ option and upload list directly to ONA Surveys.
• Click to download the list template. • Save it on your hard-drive and
open the spreadsheet
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 27
Creating lists
Mailing list – must have this one!(while you can use any worksheet which has an ‘email’ column as your mailing list we recommend that you stick with the name ‘Mailing List’ to avoid confusion)
Relationship lists (one or more)You can rename these.
Mailing list – must have email addressesDo not change column headings for Name and Email
You can add other column headingThis is relevant where you know e.g. ‘business unit’ upfront so no need to include in survey.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 28
Relationship lists
Only ‘Name’ is mandatory – you can add other columns as you like.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 29
Hands on: Add names
• Add some names and email addresses to the ‘Mailing list’–Add your own name and email address as well…we will need that
later for training purposes.
• Rename the relationship lists to match your project scope– Tip: Call the relationship list the same as your ‘Relationship set’
• Upload your list.
• Click on ‘Upload list’• Then type the name of the new list• Browse to locate the file on your hard-drive• Click ‘Upload File’
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 30
Hands on: Applying lists
• On the ‘Survey Options’ tab select the mailing list from the dropdown
• You will see that the worksheet name appears in brackets.• [G] indicates that it is a Google document (if you use Google)
• On the ‘Relationships’ tab select the list from the ‘Node list’ dropdown
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 31
Previewing the survey
• You can preview the survey–Requires that you have
the relationship lists set up.
• Always a great way to check for typos and logic.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 32
Hands on: Publishing survey
• Click on ‘Survey Manager’ to get to the main screen of ONA Survey
• Your survey is currently ‘Off-line’– You can edit and delete a survey which is ‘offline’. You can’t do this
once it is published
• Click on ‘Publish’ in the Action column– You can now ‘Manage’ the survey. That includes sending out emails to
respondents
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 33
Hands on: ‘Manage’ the survey – Sending out emails
• This area allow you to manage the published survey
• Click on ‘Email some’.
‘Email all’ is the button you need to click when you launch the survey to all.
Use ‘Email some’ to send the survey to a small pilot group, or to send out reminders to individuals
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 34
Hands on: Email all / Email some
• Customise the email introduction text– You can reuse the text from the
survey introduction.– You MUST retain the {URL} field.– Strongly recommended that you
leave the “If you have problem with the link above please do the following:1. Go to: {Host}2. Enter your email address ({Email}) and copy/paste the following validation token: {Token}
text in the email message
• Send the email to yourself and complete your survey.
• Tips and notes–Add a ‘firstname’ column to your
mailing list and personalise the email message.
–Only difference between email ‘all’ and ‘some’ is that you get to choose individuals with ‘some’.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 35
Hands on: Checking on progress and fixing problems
• On the ‘Survey Manager’ screen click on ‘Manage’ next to your published survey
See how many people have responded to the survey.
Fix any incorrect email addresses, or add new respondents to your existing list.
Complete a survey on behalf of a respondent.
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 36
Hands on: Downloading survey results
• You can download in a range of different formats• Today, we will concentrate on downloading for NodeXL.• If you want to create pie charts, bar charts etc you can download
the data for Microsoft Excel.• On the Survey Manager screen click on ‘Download’
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 37
Hands on: Selecting the NodeXL format
• You can choose to download the data for a single relationship set, or all of them
• Click on ‘Download GraphML Full’• This can then be opened in NodeXL…which will be covered in
Module 3
www.optimice.com.au Ι www.connectedaction.net Ι www.pattianklam.com 38
In preparation for the NodeXL module…
• Ensure you have installed NodeXL on your PC–Can be downloaded from http://nodexl.codeplex.com/–Requires Excel for Windows 2007 or 2010.– If you have issues please post on the NodeXL forum -
http://nodexl.codeplex.com/discussions
• Once installed, click on Programs / NodeXL /NodeXL TemplateYou should see the NodeXL tab in Microsoft Excel: