Appen Yukon
In Appen Yukon role, you will be reviewing online search results in order to improve their content and quality. You will be required to provide feedback and analysis on content found in search engine results and provide ratings on their relevance to the search terms used.
Appen Yukon Exam Info
Once your application is approved, you will receive a detailed e-mail about the process and the exam. After receiving the exam invitation e-mail, you have 7 days to study exam preparation materials including the 160 pages of the General Guidelines which explains the rating rules and concepts in detail. Therefore you should start studying immediately after receiving the exam invitation e-mail.
The qualification exam consists of 3 parts: You can continue with the next part only if you pass the previous one. When you complete part 1 or part 2, you’ll receive an email about the result within 5 minutes. The overall results after completing part 3, should come in 1 or 2 days after the due date of your exam.
Appen Yukon Exam PART 1 (Theoretical Part)
This part assesses your theoretical understanding of the General Guidelines. In this part there are 32 question blocks and each block has 4 statements so there will be 128 statements to answer in total.
You’ll see this rating interface when answering this part.
Let's take a look at the example below to better understand how you should complete the first part.
As you can see, all statements in this question are totally related to FullyMeets rating.
FullyMeets is a very special rating and you should be careful while using it.
If we look at the General Guidelines, it says that the FullyMeets rating can be used in the following situations;
● The query and user need must be specific, clear, and unambiguous.
● The result must be fully satisfying for mobile users, requiring minimal effort for users to immediately get or use what they are looking for.
And
● All or almost all users would be completely satisfied by the result—users would not need any additional results to fully satisfy the user intent.
So Let's look at the statements one by one.
- The first statement says that “Most queries have FullyMeets results”.
As you can see in the General Guidelines, FullyMeets is a special rating and it can only be used under certain circumstances. So, most of the queries don’t have FullyMeets results.
- The Second statement says that “www.crocheting.com is FullyMeets for the query [crocheting].
In this example the user query crocheting is not specific and very clear. The user may have many different intents for this query.
So we do not know what the user is exactly trying to achieve by this query. The user may be looking at how to crochet or different crocheting patterns.or crocheting materials.
There is no dominant interpretation for this query so that, no results can receive FullyMeets rating for this broad query.
- The third statement says "www.un.org/fr/ is FullyMeets for the query [united nations], French (FR)."
In this example the user query is very clear and specific. There is only one reasonable and dominant interpretation for this query which is to go to the official website of united nations. So this result should be rated as FullyMeets.
- The fourth statement is "www.britneyspears.com is Fully Meets for the query [britney spears images]."
In this example the dominant interpretation is to find images of Britney spears and this website cannot get FullyMeets rating.
For this query, the only result that can be rated as FullyMeets is a Special Content Result Block that shows the images of Britney Spears directly.
As you can see, in order to successfully pass the first part of the exam, you should constantly refer to the General Guidelines during the exam.
Appen Yukon Exam PART 2 (Page Quality Part)
The second part of the exam is Page Quality part. This part has 7 different web pages to evaluate their Page Quality.
You'll see this rating interface when answering this part.
At the top of the page you can see the URL of the web page which you need to evaluate which is https://quorumlife.com/where-should-i-invest-my-money-good-investments-for-beginners/5/
First of all you need to determine the purpose of the page.
In this example, the web page shows investment advices and recommendations for new investors. So, the purpose of this page is to give investment advices to beginners.
The third question asks if this page is a malicious or fraudulent page.
In our example, the web page doesn’t fit any of these statements. It doesn’t lack beneficial purpose, it doesn’t spread hate etc. So, you should mark this question as no.
For the 4th question, we need to determine who is the creator of Main Content on the landing page.
In our example, when we examine the web page, we can easily notice that the website is the content creator and responsible for the Main content on the landing page.
The fifth question is about the category of the relevant webpage.
As this webpage gives investment advices for new investors, it’s a Your Money Your Life(YMYL) Finance page, which means it can affect your future financial stability. So, you need to be careful about the Expertise, Authoritativeness and Trustworthiness of this website.
After the first 5 questions you’ll encounter a table where you can see 4 different PQ checks;
- Main content quality and amount
- Information about the website and the creator of the MC.
- Reputation of the website and the creator of the MC.
- EAT level of the website.
The first quality aspect we need to evaluate is the main content quality and amount. In our example, as the web page shows investment advices, the Main content of the landing page should be quite descriptive and accurate. Because investment advices can affect your future financial stability.
However when we examine the Main content of the page, we only see questionable short advices. So, we should mark the Low quality MC, Unsatisfying Amount of MC and Questionable accuracy of MC checkboxes.
After that, we need to evaluate how much information about the website and the creator of the MC is available.
In our example, if you look at the about page of the website (https://quorumlife.com/about-quorum-life/), you can only find unsatisfying amount of information about the website and the creator of the MC.
The third quality aspect is about the reputation of the website. When we search it on the Internet, we can find some mixed reputation for a YMYL page. So, you should mark the Polarized or mixed reputation checkbox.
You should also provide reputation information you found on the comment section.
The last quality aspect you need to evaluate is the EAT level (Expertise, Authoritativeness, Trustworthiness) of the website.
In our example, there is unsatisfying information about the creator of the content and also, there is no evidence that the author has financial expertise on the topic. Therefore the EAT level of the this page should be marked as Low.
After evaluating the quality aspects, you should assign an overall page quality rating for the page.
For the Overall Page Quality Rating; as this page is a YMYL financial page, lacking expertise is a reason for a Low rating. So that, the overall page quality rating of this page should be Low.
After that, you should also explain the reasons and your findings that affect your overall rating for the page using comment box.
Appen Yukon Exam PART 3 (Needs Met Part)
If you successfully pass the second part, you’ll reach the third and last part of the exam which is NeedsMeet part.
In this part, you need to rate 7 different tasks and each task consists of 8 to 10 result blocks so you will have approximately 60 result blocks to evaluate.
For this part, you'll see the following rating interface.
First of all, you should understand and determine the user intent. In this example, the user query is “What is Mammon”. The user wants to learn what Mammon is.
Once you understand the user intent, you should think about what kind of result can get the highest rating for this particular query. As you may guess, only a SCRB, a special content result block that shows comprehensive and accurate information can get a FullyMeets rating for this particular query.
So, for any other result except that, Highly Meets rating can be the Highest rating.
After understanding the user intent we can start evaluating the results.
The first result is; https://www.vocabulary.com/dictionary/mammon. When we open the landing page, it shows a brief information showing the meaning of Mammon.
So, the Main Content of the page is good or rich enough to get HighlyMeets rating. Some users may be looking for deeper information about the topic. But also it doesn't carry any of the low Needsmet characteristics. This page can be helpful and satisfying for many users.
So, the best rating for this result would be MM or MM +.
The second result is; https://en.m.wikipedia.org/wiki/Mammon.
When we open the landing page, we can see that there is a lot of information about the topic on the Main content like the Meaning of the Word, some historic and etymological information about it etc
So we can say that this page is helpful for most users. Therefore, you should assign Highlymeets rating to this result.
In order to be successful in this part,
-
First of all, you need to understand the user intent clearly.
-
Then, consider the possible rating range that the relevant result can get.
-
If necessary, don’t forget to check similar examples in the general guidelines.
In this way you can find the correct rating for the results more easily.