Human Generated Data

Title

Untitled (students at desks in classroom)
Date

1947, printed later
People

Artist: John Deusing, American active 1940s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.163

Human Generated Data

Title

Untitled (students at desks in classroom)

People

Artist: John Deusing, American active 1940s

Date

1947, printed later

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.163

Machine Generated Data

Tags

Amazon
created on 2021-12-14

Classroom 99.9
School 99.9
Room 99.9
Indoors 99.9
Person 99.4
Human 99.4
Person 99.1
Person 99.1
Person 98.7
Person 98.6
Person 96.1
Person 95.5
Person 94.9
Person 90.9
Person 79.7
Person 75
Person 70.9
Person 68
Person 61

Clarifai
created on 2023-10-15

people 99.7
group 99.2
woman 98.5
adult 97.5
group together 97.2
many 96.8
man 95.8
education 94.9
room 94.7
audience 92.5
indoors 91.7
administration 91.1
meeting 89.5
sit 89.1
school 87.6
chair 86.4
teacher 86
league 85.4
leader 84
war 80.7

Imagga
created on 2021-12-14

classroom 62.5
room 50.8
man 37
people 32.3
male 24.8
person 23.7
group 20.9
business 20
couple 20
adult 19.9
men 18.9
office 18.3
restaurant 17.6
smiling 17.3
professional 17.1
happy 16.9
businessman 16.8
center 16.1
counter 14.8
table 14.7
sitting 14.6
meeting 14.1
teacher 13.7
corporate 13.7
indoors 13.2
shop 13.1
teamwork 13
executive 12.9
smile 12.8
lifestyle 12.3
together 12.3
friends 12.2
businesswoman 11.8
work 11.8
student 11.3
women 11.1
casual 11
indoor 10.9
team 10.7
family 10.7
computer 10.4
education 10.4
black 10.3
communication 10.1
interior 9.7
portrait 9.7
love 9.5
adults 9.5
window 9.3
bar 9.2
horizontal 9.2
modern 9.1
holding 9.1
looking 8.8
home 8.8
chair 8.6
two 8.5
attractive 8.4
hand 8.3
entertainment 8.3
success 8
handsome 8
job 8
face 7.8
color 7.8
glass 7.8
colleagues 7.8
partner 7.7
luxury 7.7
old 7.7
businesspeople 7.6
enjoying 7.6
human 7.5
technology 7.4
occupation 7.3
20s 7.3
worker 7.2
suit 7.2
working 7.1

Google
created on 2021-12-14

Font 83.9
Suit 77.7
Event 74
Team 72.7
Monochrome photography 71.7
Room 67.5
Monochrome 66.4
Class 65.9
History 64.8
Audience 63.4
Stock photography 62.4
Sitting 62.1
Crowd 57.8
Job 55.6
Academic institution 55.5
Education 54.9
Child 54.8
Collaboration 54.8
Presentation 54.5
Management 51.9

Microsoft
created on 2021-12-14

text 99.7
person 97.3
clothing 94.4
indoor 87.1
posing 70.4
human face 65.7
man 60.6
woman 52.8

Color Analysis

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 9-19
Gender Female, 99.2%
Happy 87.4%
Confused 3.8%
Disgusted 2.5%
Calm 2.3%
Surprised 1.4%
Angry 1.3%
Fear 0.8%
Sad 0.5%

AWS Rekognition

Age 5-15
Gender Male, 99.8%
Happy 72.4%
Confused 13.2%
Calm 9.7%
Surprised 1.3%
Disgusted 1.2%
Angry 1.2%
Fear 0.5%
Sad 0.5%

AWS Rekognition

Age 10-20
Gender Female, 99.5%
Disgusted 91.3%
Angry 3.1%
Calm 2.2%
Confused 1.2%
Happy 1%
Sad 0.8%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 5-15
Gender Female, 98.4%
Happy 82.7%
Calm 16.5%
Angry 0.3%
Sad 0.2%
Surprised 0.2%
Disgusted 0.1%
Fear 0.1%
Confused 0%

AWS Rekognition

Age 10-20
Gender Male, 79.1%
Calm 91.4%
Surprised 4.9%
Happy 2.4%
Angry 0.6%
Sad 0.3%
Disgusted 0.2%
Confused 0.1%
Fear 0.1%

AWS Rekognition

Age 6-16
Gender Male, 89.1%
Confused 88.7%
Sad 6%
Calm 2.5%
Surprised 1.5%
Angry 0.7%
Disgusted 0.3%
Fear 0.2%
Happy 0.2%

AWS Rekognition

Age 10-20
Gender Male, 77.2%
Sad 92.9%
Angry 4.1%
Confused 1.5%
Calm 1.3%
Fear 0.1%
Disgusted 0%
Surprised 0%
Happy 0%

AWS Rekognition

Age 5-15
Gender Female, 86.7%
Sad 52.6%
Calm 26.2%
Angry 14.7%
Confused 3.5%
Disgusted 1.3%
Happy 0.7%
Surprised 0.4%
Fear 0.4%

AWS Rekognition

Age 12-22
Gender Male, 94.9%
Calm 88%
Confused 6.9%
Angry 1.4%
Happy 1.3%
Surprised 0.8%
Sad 0.8%
Disgusted 0.5%
Fear 0.2%

AWS Rekognition

Age 3-9
Gender Male, 99.6%
Happy 95.7%
Calm 1.7%
Confused 1%
Angry 0.8%
Surprised 0.3%
Sad 0.2%
Fear 0.2%
Disgusted 0.1%

AWS Rekognition

Age 5-15
Gender Male, 96.6%
Happy 96.4%
Calm 2.2%
Confused 0.5%
Disgusted 0.2%
Sad 0.2%
Surprised 0.2%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 6-16
Gender Female, 97.5%
Calm 94.3%
Happy 1.7%
Sad 1.3%
Angry 0.8%
Disgusted 0.6%
Confused 0.6%
Surprised 0.4%
Fear 0.2%

AWS Rekognition

Age 5-15
Gender Male, 98.1%
Calm 58.6%
Happy 16.2%
Disgusted 6.8%
Angry 5.8%
Confused 4.4%
Sad 4.1%
Surprised 3.3%
Fear 0.8%

AWS Rekognition

Age 11-21
Gender Male, 60.4%
Calm 82.2%
Sad 10.6%
Confused 1.9%
Angry 1.6%
Fear 1.5%
Surprised 1%
Happy 0.9%
Disgusted 0.3%

AWS Rekognition

Age 7-17
Gender Male, 66.9%
Calm 99.3%
Sad 0.3%
Surprised 0.1%
Confused 0.1%
Fear 0.1%
Angry 0.1%
Happy 0.1%
Disgusted 0%

AWS Rekognition

Age 3-9
Gender Male, 59.7%
Calm 85%
Angry 5.4%
Confused 3.9%
Disgusted 1.9%
Sad 1.5%
Surprised 0.9%
Fear 0.9%
Happy 0.7%

AWS Rekognition

Age 4-14
Gender Female, 79.7%
Calm 79.5%
Sad 9.2%
Confused 4%
Angry 2.2%
Fear 2.1%
Happy 1.6%
Surprised 0.8%
Disgusted 0.6%

AWS Rekognition

Age 26-40
Gender Male, 77.5%
Sad 83%
Calm 11.4%
Fear 1.6%
Angry 1.5%
Confused 1.3%
Happy 0.7%
Surprised 0.3%
Disgusted 0.2%

AWS Rekognition

Age 5-15
Gender Female, 96.4%
Sad 73.1%
Calm 15.3%
Angry 5.8%
Fear 2.6%
Confused 1.8%
Happy 0.6%
Disgusted 0.4%
Surprised 0.4%

AWS Rekognition

Age 6-16
Gender Male, 52.5%
Calm 61.4%
Angry 22.6%
Disgusted 3.9%
Confused 3.1%
Sad 2.9%
Happy 2.8%
Surprised 2.3%
Fear 1%

AWS Rekognition

Age 36-52
Gender Male, 88.6%
Calm 97.4%
Surprised 0.6%
Sad 0.6%
Happy 0.5%
Angry 0.3%
Confused 0.2%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 18-30
Gender Female, 97.8%
Calm 90.3%
Sad 2.5%
Surprised 2.2%
Happy 1.4%
Angry 1.4%
Fear 1.3%
Disgusted 0.5%
Confused 0.5%

AWS Rekognition

Age 16-28
Gender Male, 96.1%
Calm 89.1%
Sad 3.2%
Angry 2.6%
Confused 1.7%
Surprised 1.6%
Fear 0.9%
Disgusted 0.7%
Happy 0.3%

AWS Rekognition

Age 5-15
Gender Male, 71.1%
Happy 56.4%
Calm 28.8%
Surprised 8.9%
Disgusted 2.4%
Confused 1.4%
Angry 0.9%
Fear 0.8%
Sad 0.5%

AWS Rekognition

Age 3-11
Gender Female, 92.2%
Calm 95.4%
Happy 2.4%
Confused 1.1%
Sad 0.5%
Angry 0.2%
Surprised 0.2%
Fear 0.1%
Disgusted 0.1%

AWS Rekognition

Age 6-16
Gender Male, 93.8%
Calm 79.7%
Sad 6.9%
Happy 5.3%
Confused 2.8%
Angry 2.1%
Fear 1.5%
Surprised 1%
Disgusted 0.8%

AWS Rekognition

Age 12-22
Gender Female, 90%
Calm 63.5%
Sad 21.7%
Confused 12.3%
Angry 0.7%
Surprised 0.5%
Fear 0.5%
Disgusted 0.5%
Happy 0.3%

AWS Rekognition

Age 16-28
Gender Female, 52.8%
Happy 82.5%
Calm 6.2%
Fear 5.6%
Sad 2.2%
Angry 1.6%
Surprised 1.2%
Confused 0.4%
Disgusted 0.3%

AWS Rekognition

Age 2-8
Gender Male, 88.3%
Confused 61.2%
Calm 19.1%
Sad 5%
Angry 5%
Happy 4.2%
Surprised 3.6%
Fear 1%
Disgusted 0.9%

AWS Rekognition

Age 28-44
Gender Male, 81.3%
Calm 55.5%
Sad 27.8%
Happy 6.6%
Angry 3.5%
Confused 3.3%
Disgusted 1.4%
Fear 1.3%
Surprised 0.6%

AWS Rekognition

Age 13-23
Gender Female, 96.9%
Happy 47.5%
Calm 37.8%
Confused 4.5%
Surprised 2.6%
Disgusted 2.4%
Sad 2.1%
Fear 1.6%
Angry 1.4%

AWS Rekognition

Age 18-30
Gender Female, 52.1%
Calm 46.2%
Disgusted 20.8%
Sad 11.8%
Angry 9.9%
Confused 5%
Fear 2.6%
Happy 2.2%
Surprised 1.5%

AWS Rekognition

Age 21-33
Gender Female, 98.4%
Calm 86.2%
Surprised 9.2%
Confused 1.7%
Sad 1.1%
Happy 0.6%
Disgusted 0.5%
Angry 0.5%
Fear 0.2%

AWS Rekognition

Age 46-64
Gender Male, 71.4%
Calm 73.7%
Sad 18.2%
Confused 4.7%
Angry 1%
Fear 0.8%
Happy 0.8%
Surprised 0.6%
Disgusted 0.3%

AWS Rekognition

Age 16-28
Gender Female, 63.5%
Calm 75.2%
Happy 7.5%
Sad 6.7%
Confused 5.6%
Surprised 1.7%
Angry 1.6%
Fear 1%
Disgusted 0.8%

AWS Rekognition

Age 13-25
Gender Male, 54.5%
Calm 85.9%
Sad 5.9%
Fear 2.6%
Happy 1.6%
Surprised 1.5%
Angry 1.2%
Confused 1.2%
Disgusted 0.3%

AWS Rekognition

Age 26-40
Gender Female, 90%
Sad 85.6%
Calm 9.2%
Fear 2.6%
Confused 1.5%
Surprised 0.4%
Angry 0.3%
Happy 0.2%
Disgusted 0.1%

AWS Rekognition

Age 23-37
Gender Female, 68.2%
Calm 82.8%
Sad 10.1%
Happy 1.9%
Angry 1.8%
Fear 1.8%
Surprised 0.8%
Confused 0.5%
Disgusted 0.3%

AWS Rekognition

Age 45-63
Gender Male, 76.9%
Sad 53.4%
Calm 37.5%
Happy 3.9%
Confused 3.4%
Angry 0.7%
Disgusted 0.4%
Fear 0.4%
Surprised 0.3%

AWS Rekognition

Age 3-11
Gender Male, 82.4%
Sad 78.3%
Calm 8.2%
Confused 7.3%
Disgusted 2.5%
Angry 1.5%
Fear 0.9%
Happy 0.6%
Surprised 0.6%

Microsoft Cognitive Services

Age 9
Gender Female

Microsoft Cognitive Services

Age 24
Gender Male

Microsoft Cognitive Services

Age 21
Gender Male

Microsoft Cognitive Services

Age 39
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Feature analysis

Amazon

Person 99.4%

Categories

Imagga

people portraits 96.5%
events parties 2.7%

Text analysis

Amazon

EXTRA
DAY
RAINT DAY
RAINT
VAL

Google

EXTRA
FED
EXTRA FED