Recently ÖSYM chairman “Artificial intelligence will create the exam questions.” formed He made a statement. Minister, human factor Although he has indicated that he will not be put on the back burner, it seems that many question marks will remain.

We present you today the most popular artificial intelligence tool. We had ChatGPT prepare 4 OSYM-style questions and asked for their answers. We then asked one of our teachers about the results. Let’s see what kind of results were achieved and discuss together:

First of all, you can download the visual of the 2021-AYT/Science question from the ÖSYM website. By giving it to ChatGPT We asked him to ask a similar question:

Note: Since ÖSYM does not allow sharing the question it created, we have to censor it.

Then ChatGPT prepared a question for us as follows:

It actually looks very well prepared, doesn’t it? You may not have seen the question we asked as an example because we censored it, but He prepared an almost similar question. He even paid attention to his painting and created an original question. So is it really as good as it seems?

We asked him to solve this question in detail and then give the answer:

To summarize: We can say “Spider-Man points at each other” because he found the answer “20”. Like solved not once, but twice and again came to the same conclusion. After finding the answer in the first one, he realized that this answer was not in the options and contradicted himself. “This option does not exist in the question, so there must be an error in the solution.” he said and started solving it again.

After exhausting his brain for a long time, he found the answer “20” again and “The question is incorrect or there is a typo.” He said, talking to himself. We all think, “You prepared the question, how can the question be wrong?” we talked and laughed a lot. There’s a funny side to it…

We contacted chemistry teacher Muzaffer Baz to confirm the answer “20” he found, and we were even more surprised when he gave us the following answer:

The reason why artificial intelligence found the answer wrong is probably as our teacher said. It’s because the problem is wrong. Because if you go up and read a little bit, he tries to solve it based on assumptions and gets confused. In addition, even though the questions were prepared with artificial intelligence, our teacher also provided the following answers:

We thank him for his answers.

Maybe some of you will say, “You asked the question visually, try it in text form too.” We gave him another chance and had him prepare a math question:

We were initially hopeful because it was a math question, but the result was not as we expected. ask Let’s write text and change the prompt. However, this time we had a much worse result. This time the result was so bad that an error even occurred.

“Make sure the answer to the question you’re asking is among the options.” As we said, he started solving the question as soon as we asked him He couldn’t get out.

As a result, artificial intelligence does not seem to be a reliable source at this time.

Yes, artificial intelligence is very popular today and will certainly reach incredible levels over time, but as it is now, it will not be possible to answer the questions of our teachers. does not have the competence to prepare.

Artificial intelligence is more now 2-3 years old And like a baby who just learns everything. You give it something, you teach it and teach it. In return, he will give you the same answers you taught him.

We used ChatGPT 4 here without any training We asked him to prepare similar questions. If we had asked ÖSYM to ask more than one question and learn the question styles and writing styles, the results might have been different, we don’t know.

The version we are currently using can retrieve data from the Internet, but cannot act on its own. Even Even when it gets data from the Internet, it sometimes fabricates the information may provide incorrect information. Once upon a time, “Who wants to be a millionaire?” He also gave wrong answers to some questions in the competition.

We don’t know exactly how ÖSYM will tackle this problem.

Presumably they won’t do anything like we did. When what we don’t know is in the background have the right data set, are trained and designed If there is a system in place, they can achieve much more efficient results compared to these simple examples. Therefore, it may not make sense to immediately come to the conclusion we stated in the title.

There may come a day when the barriers to artificial intelligence will be removed. a decent learning algorithm If it can be developed and quickly learn and understand all the data on the Internet or the world’s agenda, then maybe they will write these articles, not us.

What is your opinion on this subject?

Our other artificial intelligence content that may interest you: