Skip to content
CV Rocket
Get started
How it worksThe enginePricingBlogContactSign in

Open nowPosted 62 days ago

Research Intern - AI Evaluations

Karya20 open roles

Where
Bengaluru
Get the CV for this job

From $25 per CV, paid once. No subscription.

Your applicationOpen nowResearch Intern - AI EvaluationsKarya · Bengaluru

  1. YouYes, apply to this one.

  2. CV RocketCV written for this posting.

  3. 25 readersRecruiter, hiring manager, skeptic. Round after round.

  4. CV RocketApplied on Karya's own form.

The reply lands in your private mailbox

3×more interviews than doing it yourself with ChatGPT.

The clock on this job

Early applications get read.

13.4% of postings close within 7 days. Measured by our own scanner across the market. Karya postings stay open a median of 39 days.

Share of postings closed within
  1. 2.2%1 day
  2. 4.6%3 days
  3. 13.4%7 days
  4. 21.6%14 days
  5. 36.2%30 days
  6. 59.0%60 days
This job: posted 62 days ago

Karya median: 39 days open

The posting

About Karya:

Why was Karya on the cover of the Time Magazine , highlighted by Satya Nadella , and chosen by Google as its partner for Project Vaani?

In part, because Karya is on a mission to provide AI enabled earning and learning opportunities to economically underserved communities, thereby building a pathway out of poverty for them. Karya achieves this while also delivering high quality, timely, and price competitive data to its clients.

Karya's workers make at least 20 times the Indian minimum wage and through our one-of-a-kind digital work platform, we have delivered over 40 million digital tasks and are poised to positively impact over 100 thousand workers by the end of the year. In the coming years, our goal is to rapidly scale our impact by bringing economic opportunities to millions of underserved users in India.

The Role

At Karya, we're building AI evaluation systems that measure and understand whether these systems actually work for the communities they're meant to serve. We're looking for a research intern who can bring a social science lens into this work, specifically around evaluating language technologies (speech, text, and translation systems) built for and with Indian communities.

You'll be embedded with the Evaluations team within Karya's tech team, which means you'll get a front-row seat to the full arc of AI work happening in India today from how models are built, to how they're tested, to how they land in the hands of rural and economically underprivileged communities. You'll be expected to stay current on AI evaluation science itself, and use your disciplinary training to ask sharper questions about what these systems are actually doing, and to whom.

Concretely, this means:

  • Applying social science research methods (qualitative and/or quantitative) to the evaluation of AI/ML systems, particularly language technologies
  • Contribute to developing AI evaluation and testing methodologies
  • Investigating how these technologies interact with and affect the communities they're deployed among, especially in rural and low-resource contexts in India
  • Working closely with the Evaluations team to understand both the "build" and "evaluate" sides of AI systems

This role is well suited to someone who's curious about tech and wants to put their social science training into practice. You'll be working alongside engineers, bringing a rigorous footing and a social science researcher's lens into a technical space. If you're a social science student or researcher who's been eyeing the AI/tech space and wondering how to get in, this is that entry point. You'll work on live evaluation pipelines, with communities across India, on low- and high-resource language technologies, alongside a team that treats social science expertise as core to the work.

Qualifications

Education

  • Currently pursuing or recently completed an undergraduate or master's degree in a social science discipline (Sociology, Anthropology, Development Studies, Gender Studies, Political Science, Economics, or Science and Technology Studies (STS)
  • No technical degree required, but demonstrated interest in and conceptual understanding of AI/ML systems is expected. E.g., through self-directed learning, coursework, or prior projects at the intersection of technology and society

Skills and Competencies

  • Strong grounding in social science research methods qualitative, quantitative, or mixed (not a hard requirement, but research training expected)
  • Comfort conducting or supporting focus group discussions (FGDs) and field visits
  • Conceptual understanding of AI/ML systems - applied AI/ML literacy - enough to engage meaningfully with concepts like model evaluation, human-in-the-loop systems, and language technologies (you don't need to code, but you should be comfortable with how these systems are built and tested)
  • Familiarity with socio-technical systems thinking (i.e., understanding technology and society as mutually shaping, not separate concerns)
  • Multilingual proficiency in Indian languages is a strong plus
  • Background in computational social science is a plus, not a requirement
  • Strong written and verbal communication skills
  • Comfort working in ambiguous, early-stage research settings

People matter at Karya and these are some of the perks and benefits we created for our team: • Flexible vacation and leave policy • Flexible work options • Insurance as per industry standards • Access to industry stalwarts and networking opportunities

Karya is an equal opportunity and affirmative action employer.

Qualified applicants will receive consideration without regard to their race, colour, religion, sex, sexual orientation, gender identity and disability.

Karya invites all qualified interested applicants to apply for career opportunities. If you are a person with a disability and need a reasonable accommodation to use our search to apply for a career opportunity, reach out at [email protected].

From $25, paid onceGet the CV for this job

What happens when you press

One press. We do the rest.

  1. A CV for this posting

    Written against Karya's own wording, from every piece of relevant proof in your profile.

  2. 25 readers review it

    Recruiter, hiring manager, skeptic and more read every draft, round after round. You get the best round.

    The review screen in CV Rocket: how each CV was read, round by round.

  3. We apply on Karya's form

    Our application engine gets through the hardest forms there are. Where a question needs you, AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

    An application in CV Rocket: every answer filled in on the employer's form.

  4. Every reply, sorted

    Karya's answer lands in your private mailbox, and we classify it on arrival: interview, question, rejection.

    The CV Rocket inbox: each employer reply classified as an interview, an action or a rejection.

  5. Reply with AI

    AI helps you write the email, checks it and sends it. We show you whether the recruiter read it.

  6. The interview in your calendar

    Full integration with your calendar. The invitation goes straight in.

    An interview invitation in the CV Rocket inbox, added to the candidate's calendar.
Get the CV for this job

From $25 per CV, paid once. No subscription.

Why it works

3×

more interviews than doing it yourself with ChatGPT.

ChatGPT writes a CV and never learns what happened to it. We see every reply. For each CV we know:

  • How it was written, and how the review scored it
  • When we applied, and how long after the posting went up
  • Which posting, which company, which city
  • Who got the interview, and who heard nothing

That is how we know which CVs get called.

Get the CV for this job

From $25 per CV, paid once. No subscription.

The numbers game

More applications. More interviews.

Every application goes out with its own CV, written for that posting and paid once. Send enough of them and the law of large numbers finds you the job.

Get the CV for this job
By hand5–10
With CV Rocket100
applications a day

Nearby

Live postings like this one

Same employer first, then the same role elsewhere.

Before you press

Straight answers

Get the CV for this job

From $25 per CV, paid once. No subscription.

What if my background isn't good enough?

We make the most of the background you have. The CV uses every piece of relevant proof your profile holds, and one of the 25 readers reads your whole profile and flags what the CV left out.

Do you really apply for me?

Yes, on the employer's own form, the hardest ones included. Where a question needs you, you answer it right there and AI suggests the best answer. Don't want us applying from our IP addresses? Use our Chrome extension: we apply straight from your own browser.

Is it a subscription?

No. You pay once per CV, from $25. Every application goes out with its own CV, written for that posting.

One job. One CV.
Paid once.

Pick the posting you want. We write for it, apply for you and catch the reply.

Get the CV for this job

From $25 per CV, paid once. No subscription.