The design of the evaluation was carried out in a step-wise fashion as outlined below:
The overall design was done in close consultation with the Niu FM Evaluation Steering Group.
A number of factors were taken into consideration when designing the research/data collection methods. It was important to capture a range of ages and ethnicities as well as achieving regional and national coverage. Age in particular was a key factor as it strongly influences radio broadcasting and programme development. Other factors included:
The methods used for the various stakeholders were:
Each of these methods is outlined in more detail below. Details of the numbers of participants in each of the interviews and focus groups are summarised in Table 23. Details of the questions asked in interviews and focus groups are provided in Appendix 2.
Stakeholder Group |
Method |
Respondents/ participants |
Broadcast and Expert Commentators |
Interviews using topic guide |
7 |
Listeners and non-listeners:
|
On-line structured questionnaire.
|
524 |
Hawkes Bay :
|
Hard copy structured questionnaire. |
270 |
Community Reference Groups |
Focus groups (3) – Topic Guide |
30 |
Media buyers:
|
Interviews |
3 |
|
On-line questionnaire |
15 |
NPRT Board |
Focus group |
7 |
Niu FM Management & |
Focus groups (2) |
12 |
Total respondents/participants |
875 |
|
An email promoting the online (website-based) questionnaire was sent to a database of 50 Pacific people. They were encouraged to forward the website link to others in their networks ('snowballing'). This approach of using electronic media with Pacific people was experimental. It was expected to attract the upwardly mobile as they made up the majority of people on the database. They were also considered to be more likely to be computer literate and have access to a computer.
Out of the 50 initial emails about the survey, 524 questionnaires were completed on-line (equivalent to a 1046% response rate). This is thought to be due to the high level of interest in Niu FM and the relative uniqueness of our method. It was evident from checking respondent characteristics against the computer IP address that members of some families had taken turns to enter their comments on Niu FM. Respondents took care to fill in the questionnaire completely, adding numerous comments.
To reach a broader income and age range, people attending the Hawkes Bay 'Spacifically Pacific' event were asked to complete the same questionnaire that was on line, but in hard copy form. This event was chosen as a survey location since it is aimed at Pacific families and secondary students. It is run jointly by WINZ, NZ Police, Department of Labour, Ministry of Health, Career Services, Ministry of Education and Tertiary Education Commission. It includes a careers day for secondary school students as well as community days with stalls and concerts. Given the limited time available to get listener feedback for the evaluation, this event provided an ideal opportunity to capture the views of Pacific people (both listeners to Niu FM and non-listeners) in a short space of time. 270 questionnaires were completed.
Topic guides tailored for each stakeholder group were developed for the focus group discussions, face to face interviews, and telephone interviews (see Appendix 2). Key stakeholder participants included media buyers, broadcasting commentators, Niu FM management and staff, the NPRT board, and members of the Pacific Community Reference Groups (CRGs)[1]. Focus groups with CRG members were held in Auckland , Wellington and Christchurch .
Notes were taken during all interviews and focus groups. The focus groups with Niu FM staff and the Wellington CRG were audiotaped and the recordings were used to verify written notes. Key data were tabulated using the topic guide questions as headings. The tables were used to analyse the data and thematic categories were devised. Relevant documentation was also sourced. This information, along with the results from the survey and participant interviews, were then incorporated into a report.
The results of the online and hard copy listener questionnaire were combined, totalling 824 responses.
1. Community Reference Groups consist of representatives of Pacific ethnic communities throughout New Zealand . They were established in eight regions by the Ministry of Pacific Island Affairs to inform the development and implementation of Pacific Capacity Building Strategy.
The survey respondents represented all ages and both genders, with a high percentage who spoke at least one Pacific language. The ethnicity of respondents closely matched the demographics of Pacific people in New Zealand . As such, the survey sample could be considered to be reasonably representative of the groups surveyed. However, it should be noted that the survey sample was designed as a purposive rather than random sample, and therefore can not be considered to be statistically representative of all Pacific people in New Zealand .
A more detailed breakdown of the respondents is provided below.
The following table presents the age structure of the survey sample.
Age |
Response Total |
Response % |
10-17 years |
133 |
20% |
18-24 years |
109 |
16% |
25-39 years |
300 |
44% |
40+ years |
138 |
20% |
No. of respondents |
680 |
86% |
(Skipped this question) |
114 |
14% |
Total Survey Respondents |
794 |
|
The highest number of respondents was in the 25 – 39 age group. There were as many respondents in the ten to seventeen year age group as in the older forty plus age group.
The table below shows the ethnicity of survey respondents. There was no question asked that linked peoples' ethnicity and the language/s they speak.
Ethnicity |
Response Total |
Response % |
Samoan |
308 |
45% |
Cook Island Maori |
148 |
22% |
Tongan |
54 |
8% |
Niuean |
28 |
4% |
Tokelauan |
20 |
3% |
Fijian |
18 |
3% |
NZ Maori |
61 |
9% |
NZ European |
28 |
4% |
Other (please specify) |
17 |
3% |
No. of respondents |
682 |
86% |
(Skipped this question) |
112 |
14% |
Total Survey Respondents |
794 |
|
Survey respondents mostly reflected the national Pacific population in terms of ethnic composition. At 45%, Samoan respondents were close to representing the total Samoan population (47%). Cook Island respondents made up 22% overall, which is within half of a percent of the proportion in the Pacific populations as a whole. Also Fijian and Tokelauan respondents closely matched the total population of 3% and 2.5% respectively, whereas Tongan and Niuean representation was about half of that in the wider Pacific population. 9% of survey respondents were Maori. There was also a small representation of New Zealand Europeans (4%).
Table 23 presents the details for the languages spoken by the survey respondents. As can be seen, a high proportion of survey respondents speak a Pacific language.
Language Spoken |
Response Total |
Response % |
Samoan |
283 |
43% |
Cook Island Maori |
116 |
18% |
Tongan |
55 |
8% |
Niuean |
25 |
4% |
Tokelauan |
21 |
3% |
Fijian |
9 |
1% |
None |
122 |
19% |
Other |
29 |
4% |
No. of respondents |
660 |
83% |
(Skipped this question) |
134 |
17% |
Total Survey Respondents |
794 |
|
Table 24 below presents the residential locations of the survey respondents. The highest number of responses overall came from Auckland , and Wellington . This is consistent with the national pattern, although Auckland Pacific people were under-represented compared with the total Pacific population. As seen in the table below, there were a high number of respondents from Hawkes Bay . This was due to the hard copy survey being conducted at the Spacifically Pacific event held in Hawkes Bay . However, there is no obvious reason why the Hawkes Bay responses would be substantially different from the views of Pacific people in other regions.
Region |
Response Total |
Response % |
Wider Population % |
Auckland Region |
238 |
35% |
67% |
Wellington Region |
161 |
23% |
14% |
Hawkes Bay |
242 |
35% |
2% |
Other |
50 |
7% |
17% |
No. of respondents |
691 |
87% |
|
Skipped this question) |
103 |
13% |
|
Total Survey Respondents |
794 |
|
|
The National Pacific Radio Network was established to contribute directly to the Government's goals for reducing inequalities and building the capacity of Pacific communities. This evaluation takes cognisance of this overarching goal focussing on the sixteen Government and Trust Deed objectives (many of which are outcome orientated).
Many of the objectives must be related to behaviour change to be successfully achieved. Many factors, which cannot be isolated to the endeavours of Niu FM, may influence these outcomes. To evaluate the impact of Niu FM in influencing the social outcomes identified for Pacific People, we have synthesised the above objectives and identified pathways that may be used to communicate the messages required to affect change. The identified pathways are explained below.
Connectedness is very important for Pacific migrants with limited English. Niu FM can provide a pathway for them to hear their own language, and to feel connected to their ethnic community in the islands and in New Zealand .
Connectedness is also important for first and second generation Pacific people with fluent English. They gain the opportunity to hear their own language, develop a better sense of leaders and heroes (beyond what is provided on the rugby field), and feel connected to the activities of their ethnic communities across New Zealand .
The government has a wide range of messages that it is seeking to impart to Pacific peoples. These include messages targeted at Pacific peoples such as healthy eating and early detection of diabetes. It also includes messages that have a wider audience but limited effective channels for reaching Pacific peoples. Examples include road safety, meningitis injections, education courses, encouragement of trade training, border control for bringing food into New Zealand and welfare entitlements.
Pacific peoples are also keen to be informed of upcoming events such as Pacific festivals, visits to New Zealand by Pacific leaders as well as to hear opinions on Pacific affairs.
For those with limited English, Pacific language programmes are a critical channel for hearing the news and information that helps them in their everyday lives.
Radio can assist this process through providing awareness of role models for Pacific people. Esteem can also be enhanced through reflecting a Pacific identity through Pacific-style music, the character of the station, and positive news stories about Pacific people.
Information is only a first step in making a difference. Adoption and diffusion literature (and consumer decision-making literature) describe steps in a process that include awareness > interest > questioning > decision > action > post action feelings. It also includes a process by which opinion leaders and those at the center of social networks influence those around them, who in turn influence others.
While information provision is important, also of interest is the likelihood that this information will be acted on. Largely this is the responsibility of government agencies, public relation specialists and advertising agencies to design and implement campaigns that lead to action. The role that a national Pacific radio station can play in this process is twofold. Firstly, it provides a channel for information to be imparted as part of a mix of channels. The wider the mix of channels the more likely the message is to be heard and acted on.
Secondly, the character of the radio station can influence the likelihood of information leading to action. If the radio station is perceived as an opinion leader with the characteristics of being energizing and authoritative then it is more likely to assist the process of moving awareness to action.
Our research method was designed to provide a window on these pathways.
A series of research methods were designed to capture the views of broadcast commentators, key people involved with Niu FM, buyers of advertising space, government departments seeking to have their messages heard by Pacific people, as well as listeners and non-listeners.
A number factors were taken into consideration when designing the research approaches. They included the following.
In order to reach the range of people mentioned above, different evaluation approaches were used. These included the following.
The evaluation questions were developed by the evaluators and the Ministry for Culture and Heritage Steering Group. These questions were addressed using qualitative and quantitative based approaches.
|
MONDAY |
TUESDAY |
WEDNESDAY |
THURSDAY |
FRIDAY |
SATURDAY |
SUNDAY |
5.58 am |
Blessing |
Blessing |
Blessing |
Blessing |
Blessing |
Blessing |
Blessing |
6.00 a.m. |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Stadium Sports Show |
Soul Food Gospel |
6.30 a.m. |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Stadium Sports Show |
Soul Food Gospel |
7:00 a.m. |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Stadium Sports Show |
Soul Food Gospel |
7.30 a.m. |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Stadium Sports Show |
Soul Food Gospel |
8:00 a.m. |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Stadium Sports Show |
Soul Food Gospel |
8.30 a.m. |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Pacific News Wave |
Stadium Sports Show |
Soul Food Gospel |
9:00 a.m. |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Breakfast with Mars & Stephie T |
Stadium Sports Show |
Slow Jams Sunday |
10:00 a.m. |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
Fresh View with Sandra Kailahi |
Slow Jams Sunday |
11:00 a.m. |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
Fresh View with Sandra Kailahi |
Slow Jams Sunday |
Midday |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
Fresh View with Sandra Kailahi |
Reggae Rhythms |
12.30 p.m. |
Pac News Wave |
Pac News Wave |
Pac News Wave |
Pac News Wave |
Pac News Wave |
Fresh View with Sandra Kailahi |
Reggae Rhythms |
1:00 p.m. |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
The Heat with Tuaratini |
Fresh View with Sandra Kailahi |
Reggae Rhythms |
2:00 p.m. |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
Icons & Legends |
Reggae Rhythms |
3:00 p.m. |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
Icons & Legends |
Pacific Charts |
4:00 p.m. |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
Icons & Legends |
Pacific Charts |
5:00 p.m. |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
PacDrive with Sela |
Icons & Legends |
Pacific Charts |
MONDAY |
TUESDAY |
WEDNESDAY |
THURSDAY |
FRIDAY |
Saturday |
Sunday |
|
6:00 p.m. |
Pac Drive The Remix (Youth Show) |
Pac Drive The Remix (Youth Show) |
Pac Drive The Remix (Youth Show) |
Pac Drive The Remix (Youth Show) |
Fijian Language Programme |
Auto Music |
Auto Music |
7:00 p.m. |
Etu O Matariki - Cook Islands Youth Show |
Auto Music |
Auto Music |
Auto Music |
Fijian Language Programme |
Auto Music |
Auto Music |
8:00 p.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Tuvaluan Language Programme |
Urban Fale - Youth Show |
Samoan Language Programme |
9:00 p.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Tuvaluan Language Programme |
N3 - Virtual Niteclub |
Samoan Language Programme |
10:00 p.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Tokelauan Language Programme |
N3 - Virtual Niteclub |
Samoan Language Programme |
11:00 p.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Tokelauan Language Programme |
N3 - Virtual Niteclub |
Samoan Language Programme |
Midnite |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Smooth Grooves |
N3 - Virtual Niteclub |
Samoan Language Programme |
2:00 a.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Smooth Grooves |
N3 - Virtual Niteclub |
Samoan Language Programme |
3:00 a.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Smooth Grooves |
Auto Music |
Samoan Language Programme |
4:00 a.m. |
Cook Islands Language Programme |
Niuean Language Programme |
Tongan Language Programme |
Samoan Language Programme |
Smooth Grooves |
Auto Music |
Samoan Language Programme |
5:00 a.m. |
Auto Music |
Auto Music |
Auto Music |
Auto Music |
Smooth Grooves |
Auto Music |
Auto Music |
6:00 a.m. |
Auto Music |
Auto Music |
Auto Music |
Auto Music |
Smooth Grooves |
Auto Music |
Auto Music |
(This information was supplied by Niu FM)
Pacific Music on NiuFM is inclusive of songs in Pacific Languages and those by Pacific artists in English language. Pacific Artists are a mix of primarily NZ based artists, and those in the Pacific region (Oceania including Hawaii ) as well as international artists (i.e Australia , North America and so on).
8pm-12midnight (Community Programmes Monday-Thursday & Sunday)
Midnight-4am Community Programmes (not including Saturdays)
6pm - Midnight (Community Programmes Fridays)
4am-6am (Automation)
6am-7pm (Day Shows Mon-Thurs & Sunday only)
7pm-8pm (Automation Mon, Thurs & Sunday only)
6am-6pm (Day Shows on Friday only)
Midnight-Midnight (Friday-Saturday only)
On average 244 songs are played per day and 112 of those songs are a mix of Pacific Language Songs and Pacific Artists Songs in English.
As a percentage 45% of all the songs we play on any given day are a mix of Pacific Language Songs and Pacific Songs in English.
This will increase by another 1% as some of our new Pacific Language Songs and Pacific Songs in English start off in the highest rotate category like "A"Songs (these are the most popular songs at that the time). As new "A" Songs are made available the existing songs in that category will move to the relevant Pacific categories e.g. P1 & P2.
(Please note: this appendix has been removed from the published version because it contains information relating to Niu FM's promotional and advertising activities, which has been adjudged commercially sensitive)