Back to browse
GitHub Repository

A list of AI/LLM R&D Projects where AI helps me with ideas and research

0 starsPython

Proxy Block-CAGE, a new sparse block attention

by iqbal1980·Jun 24, 2026·1 point·0 comments

AI Analysis

PassBold Bet

AI-generated attention mechanism proposal with zero benchmarks or working code.

Strengths
  • Creative approach using genetic algorithms to discover attention optimizations
  • Author transparent about bioinformatics background and AI-assisted research process
Weaknesses
  • No implementation, benchmarks, or runnable code to evaluate the proposal
  • Markdown spec without substance cannot be assessed against existing attention methods
Category
Target Audience

AI/ML researchers interested in transformer attention optimization

Post Description

Hi, I'm a PhD student in Bioinformatics/Computational Biology with a software engineering background,

I'm trying to pivot toward AI/ML research. I'm familiar with the practical side of AI as in using, Scikit learn, R, Pytorch, ONNX Runtime etc...

I was thinking if LLMs could be used as a research assistant to create better AIML algorithms. So I asked ChatGPT to help find better way to solved one of the most computationally intensive problems in Transformer architecture based model. I instructed ChatGPT to use genetic algorithms, genetic programming and other optimization techniques (Something I use extensively in my bioinformatics research) to find better Attention methods in transformers and this was the result. I would love to get feedback and comments from the AIML research community. Please read the md file and get back to me.

Hope you find this useful.

Thank you

Similar Projects