Human Generated Data

Title

Untitled (small children group photo, possibly a class photo in classroom)

Date

c. 1950

People

Artist: Lucian and Mary Brown, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.17002

Human Generated Data

Title

Untitled (small children group photo, possibly a class photo in classroom)

People

Artist: Lucian and Mary Brown, American

Date

c. 1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.2
Human 99.2
Person 99.1
Person 98
Person 97.9
Person 97.4
Person 97.3
Clothing 96.9
Apparel 96.9
Dress 96.7
Person 96.5
Person 95.9
Chair 95.6
Furniture 95.6
Person 95.5
Person 94
Face 93.7
Helmet 92.3
Female 90.4
Person 87.6
Child 84.1
Kid 84.1
Person 81.7
People 79.2
Poster 79.2
Advertisement 79.2
Indoors 77.7
Shorts 77.1
Floor 76.3
Person 76.2
Girl 76.1
Room 75
Overcoat 73.2
Suit 73.2
Coat 73.2
Crowd 71
Photography 66.8
Photo 66.8
Portrait 66.8
Text 65.9
Person 63.7
Woman 63.4
Meal 62
Food 62
Helmet 61.8
Table 60.6
School 60
Collage 59.9
Baby 59.3
Helmet 58.9
Classroom 58.5
Kindergarten 58
Smile 57.9
Play 56.2

Imagga
created on 2022-02-26

gymnasium 79.7
athletic facility 64
facility 47.9
person 33.3
people 31.2
blackboard 30.3
male 29.8
man 26.2
classroom 24.5
dance 23.5
education 23.4
silhouette 22.3
teacher 21.1
student 20.5
school 20.4
businessman 20.3
business 18.8
group 17.7
board 16.5
class 16.4
hand 16
crowd 15.4
chart 15.3
adult 15.2
happy 15
human 14.2
lights 13.9
black 13.8
men 13.7
cheering 13.7
room 13.7
success 13.7
teaching 13.6
portrait 13.6
team 13.4
writing 13.2
sport 13
symbol 12.8
stadium 12.7
icon 12.7
work 12.6
diagram 12.5
art 12.4
college 12.3
nation 12.3
training 12
flag 11.9
creation 11.8
audience 11.7
patriotic 11.5
vibrant 11.4
child 11.2
drawing 11.2
athlete 11
chalkboard 10.8
job 10.6
boy 10.4
looking 10.4
meeting 10.4
study 10.3
vivid 10.2
glowing 10.1
bright 10
modern 9.8
nighttime 9.8
finance 9.3
teamwork 9.3
event 9.2
player 9.2
competition 9.1
businesswoman 9.1
sign 9
design 9
one 9
technology 8.9
lesson 8.8
chalk 8.8
professional 8.7
exam 8.6
university 8.6
youth 8.5
casual 8.5
manager 8.4
world 8.1
office 8
financial 8
lifestyle 7.9
couple 7.8
smile 7.8
teach 7.8
skill 7.7
performance 7.7
muscular 7.6
sketch 7.6
gesture 7.6
smart 7.5
teenager 7.3
exercise 7.3
sexy 7.2
music 7.2
computer 7.2
planner 7.1
shiny 7.1
love 7.1
creative 7.1

Google
created on 2022-02-26

Font 81.9
Monochrome 73.7
Event 65.6
Photo caption 65.2
Team 64.9
Art 61.5
Room 61
Crew 58.8
T-shirt 58.7
Advertising 58.1
Illustration 57.3
Child 55.4
Visual arts 51.6
Metal 51

Microsoft
created on 2022-02-26

text 99.3
person 97.8
clothing 87.9
posing 85
player 83.3
cartoon 54.8
footwear 50.7
female 49.4
team 28.8

Face analysis

Amazon

AWS Rekognition

Age 34-42
Gender Male, 50.7%
Happy 90.8%
Calm 3.3%
Sad 2.2%
Disgusted 1.1%
Angry 1%
Fear 0.7%
Surprised 0.6%
Confused 0.3%

AWS Rekognition

Age 23-31
Gender Female, 72.5%
Calm 94.9%
Sad 1.3%
Fear 1.3%
Angry 1%
Surprised 0.5%
Disgusted 0.5%
Happy 0.3%
Confused 0.2%

AWS Rekognition

Age 26-36
Gender Male, 99.8%
Sad 32.2%
Calm 31.4%
Happy 14.7%
Surprised 6.3%
Angry 5.2%
Disgusted 5.1%
Fear 3.4%
Confused 1.6%

AWS Rekognition

Age 18-24
Gender Female, 55.9%
Happy 41.5%
Surprised 25.6%
Angry 13%
Fear 12%
Calm 3.2%
Sad 2.1%
Disgusted 1.5%
Confused 1%

AWS Rekognition

Age 38-46
Gender Male, 96.1%
Happy 72.2%
Calm 13.1%
Surprised 8.4%
Angry 3.6%
Fear 1%
Sad 0.8%
Disgusted 0.5%
Confused 0.3%

AWS Rekognition

Age 31-41
Gender Male, 95.5%
Surprised 72.3%
Calm 8%
Happy 7.5%
Sad 4.9%
Fear 2.8%
Angry 2.1%
Disgusted 1.3%
Confused 1.1%

AWS Rekognition

Age 33-41
Gender Male, 93.4%
Calm 76.5%
Happy 16.7%
Sad 2.8%
Surprised 1.5%
Confused 1%
Disgusted 0.7%
Fear 0.5%
Angry 0.4%

AWS Rekognition

Age 35-43
Gender Male, 86.6%
Calm 56.5%
Happy 19.2%
Surprised 13.6%
Sad 5.7%
Confused 2.2%
Disgusted 1.4%
Angry 0.9%
Fear 0.6%

AWS Rekognition

Age 31-41
Gender Male, 93.6%
Calm 82.4%
Surprised 6.5%
Sad 3.8%
Happy 2.1%
Angry 2%
Fear 1.5%
Disgusted 1.1%
Confused 0.7%

AWS Rekognition

Age 16-24
Gender Male, 50.9%
Happy 50.6%
Sad 25.1%
Calm 14.6%
Angry 2.8%
Disgusted 2.7%
Fear 1.7%
Surprised 1.4%
Confused 1.1%

AWS Rekognition

Age 27-37
Gender Male, 70.5%
Sad 64.3%
Calm 23.6%
Surprised 5.7%
Fear 3.1%
Happy 0.9%
Angry 0.9%
Disgusted 0.8%
Confused 0.8%

AWS Rekognition

Age 38-46
Gender Male, 88.6%
Surprised 69.7%
Happy 13.3%
Fear 6.1%
Sad 3.9%
Calm 3.4%
Confused 1.5%
Angry 1.1%
Disgusted 1%

AWS Rekognition

Age 23-31
Gender Male, 99.6%
Surprised 64.1%
Fear 10.5%
Angry 7.3%
Calm 6.6%
Sad 4.7%
Disgusted 4.6%
Happy 1.1%
Confused 1%

Feature analysis

Amazon

Person 99.2%
Helmet 92.3%
Poster 79.2%

Captions

Microsoft

a group of people posing for a photo 84.4%
a group of people posing for the camera 84.3%
a group of people posing for a picture 84.2%

Text analysis

Amazon

4
100
MJIR--YT3RA--

Google

MJI3-
MJI3-