Writing.io Jobs

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

• Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
• Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
• Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
• Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

• Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
• Board certification or completed residency training, with recent direct patient care (attending-level preferred);
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
• Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $70/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Clear Street is modernizing the brokerage ecosystem. Founded in 2018, Clear Street is a diversified financial services firm replacing the legacy infrastructure used across capital markets.

We started from scratch by building a completely cloud-native clearing and custody system designed for today’s complex, global market. Our platform is fully integrated with central clearing houses and exchanges to support billions in trading volume per day. We’ve agonized about our data model abstractions, created horizontal scalability, and crafted thoughtful APIs. All so we can provide a best-in-class experience for our clients.

By combining highly-skilled product and engineering talent with seasoned finance professionals, we’re building the essentials to compete in today’s fast-paced markets.

The Team: The mission of the Clear Street Active team is to provide best execution for every asset class in every market. Active is currently building a new, state-of-the-art, cloud-based trading platform providing high-performance traders access to liquidity venues across multiple asset classes, cutting-edge charting capabilities, and sophisticated order handling with the flexibility to service both the active trader and institutional workflows.

The Role:

• You will own the reliability and quality bar for an AI copilot embedded in an trading platform used by sophisticated investors

• You will design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows (including order placement)

• You will develop and maintain benchmarks: curated “golden sets,” scenario suites, stress/adversarial cases, and continuously refreshed market/regime-based test corpora

• You will build automated quality gates and regression workflows that block releases when key metrics degrade

• You will partner with engineering and product to define safe tool/action contracts (deterministic previews, confirmations, auditability) and ensure predictable assistant behavior

• You will own model improvement loops tied to evals: data collection/labeling strategies, error taxonomy, prompt/tooling changes, and when appropriate, fine-tuning or preference optimization to measurably improve benchmark performance

• You will design and operate monitoring + incident response for AI: telemetry, alerting, RCA, and “fix-forward” processes

• You will develop a deep understanding of trading concepts (margin, shorting, portfolio margin, risk, execution) and how to express them accurately and understandably to users

Tech Stack: Rust, TypeScript, Postgres, React (Web), React Native (Mobile), observability/telemetry tooling, LLM APIs + model serving, eval/training pipelines

Requirements:

• At least Eight (8) years of experience shipping production software; strong proficiency with any programming language
• Strong knowledge of computer science fundamentals, testing methodology, and systems design
• Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems (LLMs/agents/search/retrieval/ranking/recommenders)
• Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation, and deploying changes with measurable impact on benchmarks
• Ability to define metrics, build measurement pipelines, and drive engineering/product decisions from data
• Comfort working across the stack: debugging model/tooling failures, instrumenting services, and partnering with frontend/product on UX patterns that improve safety and trust
• High degree of self-motivation and willingness to jump into unfamiliar areas to solve problems

Bonus:

• Experience with fine-tuning, preference optimization, distillation, or prompt/compiler-style techniques for improving tool-use reliability
• Experience creating domain-specific benchmarks and adversarial suites (e.g., “known-bad” scenarios) for high-stakes applications
• Deep experience with trading across asset classes, margin types, etc.
• Experience with Rust and performance-sensitive services
• Experience designing incident response and SLOs for ML/AI systems

We Offer:

The Base Salary Range for this role is $180,000 - $250,000. This range is representative of the starting base salaries for this role at Clear Street. Where a candidate falls in this range will be based on job related factors such as relevant experience, skills, and location. This range represents Base Salary only, which is just one element of Clear Street’s total compensation. The range stated does not include other factors of total compensation such as bonuses or equity.

At Clear Street, we offer competitive compensation packages, company equity, 401k matching, gender neutral parental leave, and full medical, dental and vision insurance. In-office benefits include lunch stipends, fully stocked kitchens, happy hours, a great location, and amazing views.

Our top priority is our people. We’re continuously investing in a culture that promotes collaboration. We help each other through challenges and celebrate each other’s successes. We believe that modern workplaces succeed by virtue of having high-performance workforces that are diverse — in ideas, in cultures, and in experiences. We are proud to be an equal opportunity employer and put in the effort to make such a workplace a daily reality.  #LI-Remote

Clear Street is modernizing the brokerage ecosystem. Founded in 2018, Clear Street is a diversified financial services firm replacing the legacy infrastructure used across capital markets.

We started from scratch by building a completely cloud-native clearing and custody system designed for today’s complex, global market. Our platform is fully integrated with central clearing houses and exchanges to support billions in trading volume per day. We’ve agonized about our data model abstractions, created horizontal scalability, and crafted thoughtful APIs. All so we can provide a best-in-class experience for our clients.

By combining highly-skilled product and engineering talent with seasoned finance professionals, we’re building the essentials to compete in today’s fast-paced markets.

The Team: The mission of the Clear Street Active team is to provide best execution for every asset class in every market. Active is currently building a new, state-of-the-art, cloud-based trading platform providing high-performance traders access to liquidity venues across multiple asset classes, cutting-edge charting capabilities, and sophisticated order handling with the flexibility to service both the active trader and institutional workflows.

The Role:

• You will own the reliability and quality bar for an AI copilot embedded in an trading platform used by sophisticated investors

• You will design and build evaluation systems that measure correctness, safety, latency, and regression risk across market analysis, portfolio/risk reasoning, and trading workflows (including order placement)

• You will develop and maintain benchmarks: curated “golden sets,” scenario suites, stress/adversarial cases, and continuously refreshed market/regime-based test corpora

• You will build automated quality gates and regression workflows that block releases when key metrics degrade

• You will partner with engineering and product to define safe tool/action contracts (deterministic previews, confirmations, auditability) and ensure predictable assistant behavior

• You will own model improvement loops tied to evals: data collection/labeling strategies, error taxonomy, prompt/tooling changes, and when appropriate, fine-tuning or preference optimization to measurably improve benchmark performance

• You will design and operate monitoring + incident response for AI: telemetry, alerting, RCA, and “fix-forward” processes

• You will develop a deep understanding of trading concepts (margin, shorting, portfolio margin, risk, execution) and how to express them accurately and understandably to users

Tech Stack: Rust, TypeScript, Postgres, React (Web), React Native (Mobile), observability/telemetry tooling, LLM APIs + model serving, eval/training pipelines

Requirements:

• At least Eight (8) years of experience shipping production software; strong proficiency with any programming language
• Strong knowledge of computer science fundamentals, testing methodology, and systems design
• Experience building evaluation frameworks, test harnesses, and benchmark suites for complex systems (LLMs/agents/search/retrieval/ranking/recommenders)
• Experience running model improvement cycles: dataset curation, labeling/QA, offline experimentation, and deploying changes with measurable impact on benchmarks
• Ability to define metrics, build measurement pipelines, and drive engineering/product decisions from data
• Comfort working across the stack: debugging model/tooling failures, instrumenting services, and partnering with frontend/product on UX patterns that improve safety and trust
• High degree of self-motivation and willingness to jump into unfamiliar areas to solve problems

Bonus:

• Experience with fine-tuning, preference optimization, distillation, or prompt/compiler-style techniques for improving tool-use reliability
• Experience creating domain-specific benchmarks and adversarial suites (e.g., “known-bad” scenarios) for high-stakes applications
• Deep experience with trading across asset classes, margin types, etc.
• Experience with Rust and performance-sensitive services
• Experience designing incident response and SLOs for ML/AI systems

We Offer:

The Base Salary Range for this role is $180,000 - $250,000. This range is representative of the starting base salaries for this role at Clear Street. Where a candidate falls in this range will be based on job related factors such as relevant experience, skills, and location. This range represents Base Salary only, which is just one element of Clear Street’s total compensation. The range stated does not include other factors of total compensation such as bonuses or equity.

At Clear Street, we offer competitive compensation packages, company equity, 401k matching, gender neutral parental leave, and full medical, dental and vision insurance. In-office benefits include lunch stipends, fully stocked kitchens, happy hours, a great location, and amazing views.

Our top priority is our people. We’re continuously investing in a culture that promotes collaboration. We help each other through challenges and celebrate each other’s successes. We believe that modern workplaces succeed by virtue of having high-performance workforces that are diverse — in ideas, in cultures, and in experiences. We are proud to be an equal opportunity employer and put in the effort to make such a workplace a daily reality.  #LI-Remote

We're looking for experienced software engineers to build AI coding tasks from a codebase they know well.

Aerodynamics Expert (MSc. or PhD)Pay: $80–$120/hour Location: Global, fully remote Job Type: Contractor (~15 hours per week) Schedule: Flexible—you can choose the hours and days you work, including weekends if desired We are looking for a highly skilled Aerodynamics Expert to contribute to an AI training project involving computational fluid dynamics, aerodynamic analysis, engineering simulation, and Python.

Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week Check out this Loom video for more details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.

About the role Help train and evaluate AI agents that work inside a real CAD environment on long engineering tasks, work that would take an expert 10–15 hours.

Please submit your CV in English and indicate your level of English proficiency.

Mindrift connects specialists with project-based AI opportunities for leading tech companies, focused on testing, evaluating, and improving AI systems. Participation is project-based.

What this opportunity involves

We’re looking for US-based, actively practicing physicians (MD/DO) to evaluate clinical EHR vignettes for a medical AI evaluation program. General and internal medicine are our main focus. While each project involves unique tasks, contributors may:

• Evaluate clinical EHR vignettes paired with a question, a proposed answer, and a distractor “trap” answer across diagnosis and treatment tasks, spanning cardiovascular, nervous, hematologic, respiratory, digestive, urinary, reproductive, musculoskeletal, and integumentary systems;
• Score the clinical reasoning quality of benchmark items: vignette accuracy and completeness, whether the vignette gives the answer away, answer correctness and gradeability, and trap quality;
• Check whether the reasoning chain reaches the answer from vignette facts alone, correct reasoning traces, and write short rationales;
• Work within three independent blind reads, followed by physician adjudication. Real clinical complexity only. You’re improving the AI tools you’ll eventually use yourself.

If you’re a practicing physician ready to take on this challenging and engaging project, join us!

What we look for

This opportunity is a good fit for US-based physicians open to part-time, non-permanent projects. Ideally, contributors will have:

• Medical degree (MD or DO) and an active, unrestricted US medical license (verified with the issuing medical board);
• Board certification or completed residency training, with recent direct patient care (attending-level preferred);
• Broad, multi-system diagnostic and treatment experience (internal, family, emergency, or hospital medicine);
• Strong clinical reasoning: differential diagnosis, next-step management, and application of evidence-based guidelines;
• Prior experience in medical AI evaluation, clinical content or exam-question review, or medical annotation/QA (a plus);
• Strong written English (C1+).

This opportunity is not fit to medical students, unlicensed medical graduates, non-physician clinicians (NPs, PAs, nurses, pharmacists), or non-clinical healthcare titles.

Project time expectations

For this project, tasks are estimated to require around 10-20 hours per week during active phases, based on project requirements. This is an estimate, not a guaranteed workload, and applies only while the project is active. Tasks must be submitted by the deadline and meet the listed acceptance criteria to be accepted.

Compensation

Paid per accepted task. Your rate depends on the qualification tier you reach and how efficiently you complete tasks — up to the equivalent of $80/hr. Because payment is per approved task, a faster pace raises your effective hourly rate.

Headquarters: San Francisco, CA
URL: http://bit.ly/3kLhMdk

About Contra Labs

Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.

By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.

How It Works

This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.

To Join the Network

• Portfolio review - We'll assess your Contra profile and portfolio for strength in content design, with a focus on ad creative and performance-driven visual content.

• Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.

• Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.

What You May Work On

• Evaluate AI-generated games and interactive experiences for gameplay quality, technical execution, and overall player experience

• Provide clear, structured feedback on gameplay loops, mechanics, controls, physics, level design, UI, visual feedback, and overall game feel

• Help define quality benchmarks and evaluation criteria for what great AI-generated games should look, feel, and play like

• Identify common failure modes in AI-generated games, including broken gameplay loops, poor collision or physics logic, unresponsive controls, and disjointed player feedback

• Build or evaluate playable prototypes and reference experiences that demonstrate best-in-class game design and technical execution

• Contribute to research exploring how AI models can better understand and generate compelling, polished, and playable interactive experiences

What We're Looking For

• Strong portfolio showcasing high-quality game design, interactive experiences, or playable projects

• Strong understanding of game mechanics, gameplay loops, player experience, controls, and visual feedback

• Ability to articulate creative and technical feedback clearly and constructively

• Strong game design instincts and awareness of contemporary games, mechanics, interaction patterns, and player expectations

• Comfort working in fast-paced, experimental environments (experience with AI, game engines, or rapid prototyping tools is a plus)

 

To apply: https://weworkremotely.com/remote-jobs/contra-senior-game-designer

Headquarters: San Francisco, CA
URL: http://bit.ly/3kLhMdk

About Contra Labs

Contra Labs sits at the intersection of human creativity and AI. We partner with leading AI labs and product companies to improve their tools across design, video, development, and beyond. Our research is grounded in how top creatives actually work, studying the patterns behind what gets created, what gets chosen, and what resonates. We believe human input will always be at the center of net new creation, and our mission is to help shape technology so human creativity can be amplified to create what today is unimaginable.

By joining the Contra Labs network you gain access to paid projects with some of the most innovative companies building the next generation of creative and AI-powered tools.

How It Works

This is an application to join the network and be eligible for roles as they arise. Projects are staffed on an as-needed basis, typically 5 to 10 hours at a time, though some may extend into longer engagements. In unique cases, we may have full-time roles available as well. When a project matches your skill set, we'll reach out with details and timeline.

To Join the Network

• Portfolio review - We'll assess your Contra profile and portfolio for strength in content design, with a focus on ad creative and performance-driven visual content.

• Record a 30 second intro video - Share a quick 30 second introduction so we can get to know you.

• Complete profile - Once you’ve applied, we recommend completing your profile for better job matches and setting up your wallet so you can get paid when a job comes through.

What You May Work On

• Evaluate AI-generated 3D scenes, interactive environments, simulations, and spatial experiences for visual and technical quality

• Provide clear, structured feedback on scene composition, lighting, materials, physical dynamics, asset integration, interaction, and overall visual coherence

• Help define quality benchmarks and evaluation criteria for what great AI-generated 3D experiences should look and feel like

• Identify common failure modes in AI-generated 3D work, from broken physics and interactions to poor spatial composition or inconsistent visual feedback

• Create reference examples, prototypes, or "golden" outputs that demonstrate best-in-class 3D execution

• Contribute to research exploring how AI models can better understand and generate interactive 3D experiences

What We're Looking For

• Strong portfolio showcasing high-quality 3D design, interactive environments, or spatial experiences

• Strong understanding of 3D composition, lighting, materials, animation, and visual coherence

• Ability to articulate creative and technical feedback clearly and constructively

• Strong 3D design instincts and awareness of contemporary visual culture, 3D trends, and emerging digital aesthetics

• Comfort working in fast-paced, experimental environments (experience with AI, 3D tools, or creative technology is a plus)

To apply: https://weworkremotely.com/remote-jobs/contra-senior-3d-designer

ABOUT DEFCON AI

RESILIENCE IN THE FACE OF DISRUPTION. DEFCON AI is an insights company that leverages artificial intelligence, mathematical optimization, data analytics, and software engineering for resilient optimization of complex systems.

In today’s dynamically changing world, DEFCON AI’s technology aligns outcomes with operational goals, better decision making, and empowers customers to anticipate assess, and mitigate the impacts of disruptions.

Be the independent voice that keeps the whole program honest — your evaluation is the standard everyone else is held to.

About the Role

You’ll join the analytics and AI engineering team behind a system that genuinely matters: an AI-assisted platform that brings together records from dozens of disparate data sources, resolves them to the correct individual, highlights what analysts should review first, and provides transparent, explainable recommendations that users can trust. Operating within a secure government cloud environment, the platform tackles complex challenges in AI, data integration, and decision support where quality, trust, and accountability are mission-critical.

As a Model Test & Measurement Engineer, you’ll own the evaluation framework that helps ensure those systems perform as intended. You’ll build and maintain labeled ground truth datasets, design statistically sound audit and sampling methodologies, measure model performance across releases, and create the evidence packages that support deployment decisions. You’ll independently validate both scoring and generative AI capabilities, helping the team understand not only whether a model works, but how confidently its outputs can be trusted.

This is a role with genuine influence. Your assessments will inform release decisions, drive improvement efforts, and provide the objective evidence customers rely on when evaluating system performance. You’ll work closely with data scientists, AI engineers, and technical leadership while maintaining the independence needed to provide clear, defensible evaluations. You do not build the models you validate, and you do not approve thresholds or release authorization against your own evidence.

If you’re energized by measurement, validation, and making complex AI systems more trustworthy, this is an opportunity to have an outsized impact on both the technology and the mission it supports.

This is a fully remote role with occasional travel to DEFCON AI headquarters, customer sites, and partner facilities as needed.

Key Responsibilities

• Construct labeled ground truth for model evaluation

• Design and run sampled audits

• Gate releases against model version; maintain version inventory, evaluation records, and rollback triggers

• Run drift and override review

• Produce human-oversight and fairness / disparate-effect evidence

• Maintain independence from the build roles: produce evaluation evidence, but do not build the models, approve thresholds, or authorize releases against that evidence

• Measure workflow improvement: review time, throughput, backlog movement, and override and rework rates

• Design evaluation-phase QC: sample selection that does not mix populations, the unit of review, and fair comparison when methods or searched sources differ

• Define the measurement events other teams must emit, and confirm the review workspace emits workflow events from first use

Required Qualifications

• 5+ years with model validation as a named responsibility, not a side task

• Direct experience with ground-truth construction and sampling design

• Strong Python and SQL; comfort working independently from the teams whose models you evaluate

• US Citizenship Required

• Active US Secret clearance

• Elevated personnel security requirements apply to portions of this work and are discussed during screening

Preferred Qualifications

• Regulated-industry or government model-risk background

• Experience with fairness / disparate-effect testing and human-oversight documentation

• NIST AI RMF or comparable practice

• Active Top Secret clearance

What Success Looks Like

• Evaluation evidence a customer can rely on, independent of the teams that build the models

• Releases gated against a clear version and evaluation record

• Workflow metrics (review time, throughput, backlog, override/rework rates) that give the program an honest read on whether it’s working

What We Offer

• A fully remote, results-based environment

• Competitive salary, bonus, and equity package

• 100% employer paid, comprehensive health insurance including medical, dental, and vision for you and your family

• Unlimited PTO, with your manager’s approval

• Flexible work environment where you manage your work day

• 14 weeks of fully-paid parental leave

Salary Range: $150,000–$190,000. This represents the typical salary range for this position based on experience, skills, and other factors.

We’re an Equal Opportunity Employer: You’ll receive consideration for employment without regard to race, sex, color, religion, sexual orientation, gender identity, national origin, protected veteran status, or on the basis of disability.

Applicant Data Disclosure

By submitting an application, you acknowledge that Defcon AI uses third-party service providers to facilitate its recruitment and hiring processes. These providers include applicant tracking systems, candidate verification platforms, and fraud detection tools (collectively, “Hiring Platforms”). Your application materials, including your résumé, cover letter, work samples, responses to application questions, and any other information you submit, may be transmitted to and processed by these Hiring Platforms for the following purposes:

• Managing and administering your application throughout the hiring process;
• Verifying the accuracy and authenticity of application materials, including by cross-referencing information you provide against publicly available sources and proprietary databases;
• Identifying indicators of potentially fraudulent, fabricated, or materially misleading application content, including but not limited to discrepancies between submitted materials and publicly available professional profiles, geographic anomalies, and fabricated work histories.

Applications that are flagged through this process as containing indicators of fraud or material misrepresentation may be declined from further consideration. If you have questions about the status of your application or the evaluation process, please contactrecruiting@defconai.com.

Defcon AI requires its Hiring Platform providers to process your information solely for the purposes described above and in accordance with applicable law. Your information will be retained only for as long as necessary to fulfill these purposes and any applicable legal obligations, after which it will be deleted in accordance with Defcon AI’s data retention policies.

For more information about how your data is used, please refer to our Privacy Policy and Applicant Privacy Notice .

About the jobMercor connects elite creative and technical talent with leading AI research labs.

Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week Check out this Loom video for more details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.

Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week Check out this Loom video for more details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.

Contract | Remote, worldwide | $100-$200/hour depending on experience and location | 10-20 hrs/week Check out this Loom video for more details: We're looking for highly experienced software engineer (SR+) to help evaluate the quality of interactions with modern coding agents such as OpenAI Codex and Claude Code.

Role Title: Senior AI Trainer Role Type: Contractor, Remote Location: Northern America and Europe.