Skip navigation

Ministry for Culture and Heritage

Evaluation of the Impact of the Pilot National Pacific Radio Network – Niu FM

APPENDIX 1 - Evaluation Design And Methods

The design of the evaluation was carried out in a step-wise fashion as outlined below:

The overall design was done in close consultation with the Niu FM Evaluation Steering Group.

A number of factors were taken into consideration when designing the research/data collection methods. It was important to capture a range of ages and ethnicities as well as achieving regional and national coverage. Age in particular was a key factor as it strongly influences radio broadcasting and programme development. Other factors included:

The methods used for the various stakeholders were:

Each of these methods is outlined in more detail below. Details of the numbers of participants in each of the interviews and focus groups are summarised in Table 23. Details of the questions asked in interviews and focus groups are provided in Appendix 2.

Table 20: Participants in the Evaluation Process

Stakeholder Group

Method

Respondents/ participants

Broadcast and Expert Commentators

Interviews using topic guide

7

Listeners and non-listeners:

Internet users;
Upwardly mobile; and
Families.

On-line structured questionnaire.

 

524

Hawkes Bay :

Families;
Youth;
Parents; and
Community.

Hard copy structured questionnaire.

270

Community Reference Groups

Focus groups (3) – Topic Guide

30

Media buyers:

  • Advertisers; and

 

Interviews

 

3

  • Government agencies.

On-line questionnaire

15

NPRT Board

Focus group
Interviews

7
2

Niu FM Management &
Staff

Focus groups (2)
Interviews

12
5

Total respondents/participants

875

The on-line survey

An email promoting the online (website-based) questionnaire was sent to a database of 50 Pacific people. They were encouraged to forward the website link to others in their networks ('snowballing'). This approach of using electronic media with Pacific people was experimental. It was expected to attract the upwardly mobile as they made up the majority of people on the database. They were also considered to be more likely to be computer literate and have access to a computer.

Out of the 50 initial emails about the survey, 524 questionnaires were completed on-line (equivalent to a 1046% response rate). This is thought to be due to the high level of interest in Niu FM and the relative uniqueness of our method. It was evident from checking respondent characteristics against the computer IP address that members of some families had taken turns to enter their comments on Niu FM. Respondents took care to fill in the questionnaire completely, adding numerous comments.

Hard copy survey

To reach a broader income and age range, people attending the Hawkes Bay 'Spacifically Pacific' event were asked to complete the same questionnaire that was on line, but in hard copy form. This event was chosen as a survey location since it is aimed at Pacific families and secondary students. It is run jointly by WINZ, NZ Police, Department of Labour, Ministry of Health, Career Services, Ministry of Education and Tertiary Education Commission. It includes a careers day for secondary school students as well as community days with stalls and concerts. Given the limited time available to get listener feedback for the evaluation, this event provided an ideal opportunity to capture the views of Pacific people (both listeners to Niu FM and non-listeners) in a short space of time. 270 questionnaires were completed.

Focus groups and interviews

Topic guides tailored for each stakeholder group were developed for the focus group discussions, face to face interviews, and telephone interviews (see Appendix 2). Key stakeholder participants included media buyers, broadcasting commentators, Niu FM management and staff, the NPRT board, and members of the Pacific Community Reference Groups (CRGs)[1]. Focus groups with CRG members were held in Auckland , Wellington and Christchurch .

Recording and analysis of data

Notes were taken during all interviews and focus groups. The focus groups with Niu FM staff and the Wellington CRG were audiotaped and the recordings were used to verify written notes. Key data were tabulated using the topic guide questions as headings. The tables were used to analyse the data and thematic categories were devised. Relevant documentation was also sourced. This information, along with the results from the survey and participant interviews, were then incorporated into a report.

The results of the online and hard copy listener questionnaire were combined, totalling 824 responses.

1. Community Reference Groups consist of representatives of Pacific ethnic communities throughout New Zealand . They were established in eight regions by the Ministry of Pacific Island Affairs to inform the development and implementation of Pacific Capacity Building Strategy.

Profile of the survey respondents

The survey respondents represented all ages and both genders, with a high percentage who spoke at least one Pacific language. The ethnicity of respondents closely matched the demographics of Pacific people in New Zealand . As such, the survey sample could be considered to be reasonably representative of the groups surveyed. However, it should be noted that the survey sample was designed as a purposive rather than random sample, and therefore can not be considered to be statistically representative of all Pacific people in New Zealand .

A more detailed breakdown of the respondents is provided below.

Age

The following table presents the age structure of the survey sample.

Table 21: Age of Survey Respondents

Age

Response Total

Response %

10-17 years

133

20%

18-24 years

109

16%

25-39 years

300

44%

40+ years

138

20%

No. of respondents

680

86%

(Skipped this question)

114

14%

Total Survey Respondents

794

 

The highest number of respondents was in the 25 – 39 age group. There were as many respondents in the ten to seventeen year age group as in the older forty plus age group.

Ethnicity

The table below shows the ethnicity of survey respondents. There was no question asked that linked peoples' ethnicity and the language/s they speak.

Table 22: Ethnicity/s of Respondents

Ethnicity

Response Total

Response %

Samoan

308

45%

Cook Island Maori

148

22%

Tongan

54

8%

Niuean

28

4%

Tokelauan

20

3%

Fijian

18

3%

NZ Maori

61

9%

NZ European

28

4%

Other (please specify)

17

3%

No. of respondents

682

86%

(Skipped this question)

112

14%

Total Survey Respondents

794

 

Survey respondents mostly reflected the national Pacific population in terms of ethnic composition. At 45%, Samoan respondents were close to representing the total Samoan population (47%). Cook Island respondents made up 22% overall, which is within half of a percent of the proportion in the Pacific populations as a whole. Also Fijian and Tokelauan respondents closely matched the total population of 3% and 2.5% respectively, whereas Tongan and Niuean representation was about half of that in the wider Pacific population. 9% of survey respondents were Maori. There was also a small representation of New Zealand Europeans (4%).

Languages spoken

Table 23 presents the details for the languages spoken by the survey respondents. As can be seen, a high proportion of survey respondents speak a Pacific language.

Table 23: Pacific Languages Spoken by Respondents

Language Spoken

Response Total

Response %

Samoan

283

43%

Cook Island Maori

116

18%

Tongan

55

8%

Niuean

25

4%

Tokelauan

21

3%

Fijian

9

1%

None

122

19%

Other

29

4%

No. of respondents

660

83%

(Skipped this question)

134

17%

Total Survey Respondents

794

 

Residence/location

Table 24 below presents the residential locations of the survey respondents. The highest number of responses overall came from Auckland , and Wellington . This is consistent with the national pattern, although Auckland Pacific people were under-represented compared with the total Pacific population. As seen in the table below, there were a high number of respondents from Hawkes Bay . This was due to the hard copy survey being conducted at the Spacifically Pacific event held in Hawkes Bay . However, there is no obvious reason why the Hawkes Bay responses would be substantially different from the views of Pacific people in other regions.

Table 24: Location of Respondents

Region

Response Total

Response %

Wider Population %

Auckland Region

238

35%

67%

Wellington Region

161

23%

14%

Hawkes Bay

242

35%

2%

Other

50

7%

17%

No. of respondents

691

87%

 

Skipped this question)

103

13%

 

Total Survey Respondents

794

 

 

Rationale for Approach

The National Pacific Radio Network was established to contribute directly to the Government's goals for reducing inequalities and building the capacity of Pacific communities. This evaluation takes cognisance of this overarching goal focussing on the sixteen Government and Trust Deed objectives (many of which are outcome orientated).

Many of the objectives must be related to behaviour change to be successfully achieved. Many factors, which cannot be isolated to the endeavours of Niu FM, may influence these outcomes. To evaluate the impact of Niu FM in influencing the social outcomes identified for Pacific People, we have synthesised the above objectives and identified pathways that may be used to communicate the messages required to affect change. The identified pathways are explained below.

The pathways

Connectedness

Connectedness is very important for Pacific migrants with limited English. Niu FM can provide a pathway for them to hear their own language, and to feel connected to their ethnic community in the islands and in New Zealand .

Connectedness is also important for first and second generation Pacific people with fluent English. They gain the opportunity to hear their own language, develop a better sense of leaders and heroes (beyond what is provided on the rugby field), and feel connected to the activities of their ethnic communities across New Zealand .

Informed

The government has a wide range of messages that it is seeking to impart to Pacific peoples. These include messages targeted at Pacific peoples such as healthy eating and early detection of diabetes. It also includes messages that have a wider audience but limited effective channels for reaching Pacific peoples. Examples include road safety, meningitis injections, education courses, encouragement of trade training, border control for bringing food into New Zealand and welfare entitlements.

Pacific peoples are also keen to be informed of upcoming events such as Pacific festivals, visits to New Zealand by Pacific leaders as well as to hear opinions on Pacific affairs.

For those with limited English, Pacific language programmes are a critical channel for hearing the news and information that helps them in their everyday lives.

Raised Esteem

Radio can assist this process through providing awareness of role models for Pacific people. Esteem can also be enhanced through reflecting a Pacific identity through Pacific-style music, the character of the station, and positive news stories about Pacific people.

Empowerment

Information is only a first step in making a difference. Adoption and diffusion literature (and consumer decision-making literature) describe steps in a process that include awareness > interest > questioning > decision > action > post action feelings. It also includes a process by which opinion leaders and those at the center of social networks influence those around them, who in turn influence others.

While information provision is important, also of interest is the likelihood that this information will be acted on. Largely this is the responsibility of government agencies, public relation specialists and advertising agencies to design and implement campaigns that lead to action. The role that a national Pacific radio station can play in this process is twofold. Firstly, it provides a channel for information to be imparted as part of a mix of channels. The wider the mix of channels the more likely the message is to be heard and acted on.

Secondly, the character of the radio station can influence the likelihood of information leading to action. If the radio station is perceived as an opinion leader with the characteristics of being energizing and authoritative then it is more likely to assist the process of moving awareness to action.

Our research method was designed to provide a window on these pathways.

Evaluation Approaches

A series of research methods were designed to capture the views of broadcast commentators, key people involved with Niu FM, buyers of advertising space, government departments seeking to have their messages heard by Pacific people, as well as listeners and non-listeners.

A number factors were taken into consideration when designing the research approaches. They included the following.

In order to reach the range of people mentioned above, different evaluation approaches were used. These included the following.

The evaluation questions were developed by the evaluators and the Ministry for Culture and Heritage Steering Group. These questions were addressed using qualitative and quantitative based approaches.

APPENDIX 2 - Questionnaires and Topic Guides

Interviews with media buyers

  1. What is your role?
  2. Have you ever used Niu FM to advertise or promote your messages? (If no go to Question 8)
  3. Please describe the promotional activity you used Niu FM for?
  4. Why did you choose to use Niu FM?
  5. Which target audience/s do you believe you reached with Niu FM? How do you know?
  6. Was Niu FM cost effective in reaching your target audience/s?
  7. Describe your experience of dealing with Niu FM.? (Go to question 9).
  8. Why haven't you used Niu FM?
  9. To meet your needs, what audience characteristics would you want of an ideal radio station that focussed on Pacific peoples?
  10. What role do you see radio playing as a channel for government communication?
  11. Do you have any other comments or suggestions that would be helpful for the Niu FM Board in tailoring Niu FM to help in its communication to Pacific Peoples?

Topic guide for the Board interviews

  1. What is the Board's vision for Niu FM?
  2. Is your vision the same?
  3. How does the Board plan to achieve this vision?
  4. What have been Niu FM's key achievements so far?
  5. What have been the challenges facing Niu FM?
    1. How has the Board dealt with these?
    2. Was the Board been successful in dealing with these?
  6. Who are Niu FM's key target audiences?
  7. What strategies are being used to broadcast to these groups?
  8. In what ways has Niu FM contributed to Government's goal of reducing inequalities of Pacific communities?
  9. In what ways does Niu FM build the capacity of Pacific communities?
  10. How well is the Niu FM network reaching regional communities?
  11. What are your intentions for increasing listenership outside of Auckland ?
  12. What role do you think Niu FM has in communicating government policy messages? Why?
  13. What is your policy for developing Pacific broadcasters?
  14. How does the Board ensure that Niu FM announcers are of a high standard?
  15. Are there any other ways that Niu FM is building broadcasting capacity for Pacific people?
  16. Which radio programmes do you think do well?
  17. Are there any programmes that need to be improved?
  18. If so, how will you do this?
  19. How does Niu FM measure the impact of its programmes on listeners?
  20. Do you have any plans for making Niu FM commercially sustainable? If so why?
  21. Do you think the network should remain fully/partially government funded? If so why?
  22. What challenges does the Board anticipate for the future in meeting its objectives for Niu FM?

Topic guide for expert interviews

  1. What are the major changes occurring now and likely to occur in the future, in radio broadcasting in New Zealand ?
  2. From your experience what are relevant key issues for ethnic radio broadcasting?
  3. What role do you see a national Pacific radio station having in New Zealand radio broadcasting?
  4. How do you see a radio network like Niu FM placed on the radio broadcasting landscape?
  5. How effective do you think radio can be as a channel for communicating government information?
  6. What do you think is the best way to fund Pacific radio broadcasting? Why?
  7. What might be some implications for government support for radio aimed at Pacific People?
  8. Do you think that a radio network such as Niu FM can be commercially sustainable? If so why?
  9. The audience information for Niu FM shows that in the six months of operation up to December 2003, it had the second largest radio market share for Auckland , had a small share of the Wellington market, and far fewer listeners in Christchurch . Compared to other Auckland radio stations it had a more diverse age range of listeners with strong audience numbers from age 10 to 34 and good numbers from 35 to 64. What are the implications of this radio audience profile for radio programming?
  10. Are there other comments that you would like to share with us?

Topic guide for Niu FM staff

  1. What makes you proud to work for Niu FM?
  2. How successful is Niu FM as a national Pacific radio network?
  3. Who do you see are Niu FM's key target audiences?
  4. What strategies are being used to broadcast to these groups?
  5. What programmes are targeted at these particular audiences? (Management question.)
  6. Does Niu FM contribute to the development of Pacific music and artists? If so how?
  7. What percentage of the music being played on Niu FM is Pacific music?
  8. What percentage of airtime is dedicated to promoting Pacific business, Pacific services, and government services
  9. What percentage of airtime is dedicated to pacific artists and language programmes?
  10. Would you like to see any changes to the amount of
    • Pacific music
    • Government service announcements
    • Pacific language programmes? (Staff question.)
    • If so, what changes would you suggest?
  11. Is Niu FM planning to change the amount of pacific music on Niu FM? If so, what changes are planned?
  12. How well is the Niu FM network reaching regional communities? Do you think that Niu FM contributes to the community development of Pacific people? If so, how does it do this?
  13. Does Niu FM provide development opportunities for Pacific broadcasters? If so, how does it do this? ( Management question.)
  14. How do you know what your listeners like and dislike about Niu FM?
  15. Do you get feedback from media buyers? If so, what do they tell you?
  16. How are you meeting the Trust objectives? (Management question.)
  17. Is there anything that you think should be done differently to the way it is being done now? If so, what changes would you suggest?

APPENDIX 3 - Programing

Programme Schedule October 2004
(Information provided by Niu FM.)

 

MONDAY 

TUESDAY

WEDNESDAY

THURSDAY

FRIDAY

SATURDAY

SUNDAY

5.58 am

Blessing

Blessing

Blessing

Blessing

Blessing

Blessing

Blessing

6.00 a.m.

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Stadium Sports Show

Soul Food Gospel

6.30 a.m.

Pacific News Wave

Pacific News Wave

Pacific News Wave

Pacific News Wave

Pacific News Wave

Stadium Sports Show

Soul Food Gospel

7:00 a.m.

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Stadium Sports Show

Soul Food Gospel

7.30 a.m.

Pacific News Wave

Pacific News Wave

Pacific News Wave

Pacific News Wave

Pacific News Wave

Stadium Sports Show

Soul Food Gospel

8:00 a.m.

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Stadium Sports Show

Soul Food Gospel

8.30 a.m.

Pacific News Wave

Pacific News Wave

Pacific News Wave

Pacific News Wave

Pacific News Wave

Stadium Sports Show

Soul Food Gospel

9:00 a.m.

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Breakfast with Mars & Stephie T

Stadium Sports Show

Slow Jams Sunday

10:00 a.m.

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

Fresh View with Sandra Kailahi

Slow Jams Sunday

11:00 a.m.

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

Fresh View with Sandra Kailahi

Slow Jams Sunday

Midday

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

Fresh View with Sandra Kailahi

Reggae Rhythms

12.30 p.m.

Pac News Wave

Pac News Wave

Pac News Wave

Pac News Wave

Pac News Wave

Fresh View with Sandra Kailahi

Reggae Rhythms

1:00 p.m.

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

The Heat with Tuaratini

Fresh View with Sandra Kailahi

Reggae Rhythms

2:00 p.m.

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

Icons & Legends

Reggae Rhythms

3:00 p.m.

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

Icons & Legends

Pacific Charts

4:00 p.m.

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

Icons & Legends

Pacific Charts

5:00 p.m.

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

PacDrive with Sela

Icons & Legends

Pacific Charts

MONDAY

TUESDAY

WEDNESDAY

THURSDAY

FRIDAY

Saturday

Sunday

6:00 p.m.

Pac Drive The Remix (Youth Show)

Pac Drive The Remix (Youth Show)

Pac Drive The Remix (Youth Show)

Pac Drive The Remix (Youth Show)

Fijian Language Programme

Auto Music

Auto Music

7:00 p.m.

Etu O Matariki - Cook Islands Youth Show

Auto Music

Auto Music

Auto Music

Fijian Language Programme

Auto Music

Auto Music

8:00 p.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Tuvaluan Language Programme

Urban Fale - Youth Show

Samoan Language Programme

9:00 p.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Tuvaluan Language Programme

N3 - Virtual Niteclub

Samoan Language Programme

10:00 p.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Tokelauan Language Programme

N3 - Virtual Niteclub

Samoan Language Programme

11:00 p.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Tokelauan Language Programme

N3 - Virtual Niteclub

Samoan Language Programme

Midnite

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Smooth Grooves

N3 - Virtual Niteclub

Samoan Language Programme

2:00 a.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Smooth Grooves

N3 - Virtual Niteclub

Samoan Language Programme

3:00 a.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Smooth Grooves

Auto Music

Samoan Language Programme

4:00 a.m.

Cook Islands Language Programme

Niuean Language Programme

Tongan Language Programme

Samoan Language Programme

Smooth Grooves

Auto Music

Samoan Language Programme

5:00 a.m.

Auto Music

Auto Music

Auto Music

Auto Music

Smooth Grooves

Auto Music

Auto Music

6:00 a.m.

Auto Music

Auto Music

Auto Music

Auto Music

Smooth Grooves

Auto Music

Auto Music

Pacific Music Played on Niu Fm

(This information was supplied by Niu FM)

Pacific Music on NiuFM is inclusive of songs in Pacific Languages and those by Pacific artists in English language. Pacific Artists are a mix of primarily NZ based artists, and those in the Pacific region (Oceania including Hawaii ) as well as international artists (i.e Australia , North America and so on).

ANALYSIS OF NIU FM PLAYLIST:

8pm-12midnight (Community Programmes Monday-Thursday & Sunday)

Midnight-4am Community Programmes (not including Saturdays)

6pm - Midnight (Community Programmes Fridays)

4am-6am (Automation)

6am-7pm (Day Shows Mon-Thurs & Sunday only)

7pm-8pm (Automation Mon, Thurs & Sunday only)

6am-6pm (Day Shows on Friday only)

Midnight-Midnight (Friday-Saturday only)

Summary:

On average 244 songs are played per day and 112 of those songs are a mix of Pacific Language Songs and Pacific Artists Songs in English.

As a percentage 45% of all the songs we play on any given day are a mix of Pacific Language Songs and Pacific Songs in English.

This will increase by another 1% as some of our new Pacific Language Songs and Pacific Songs in English start off in the highest rotate category like "A"Songs (these are the most popular songs at that the time). As new "A" Songs are made available the existing songs in that category will move to the relevant Pacific categories e.g. P1 & P2.

APPENDIX 4 – Promotion and Sales Reports

(Please note: this appendix has been removed from the published version because it contains information relating to Niu FM's promotional and advertising activities, which has been adjudged commercially sensitive)