Human Generated Data

Title

Untitled (large group portrait of performers on stage)
Date

1946
People

Artist: Robert Burian, American active 1940s-1950s
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.19139

Human Generated Data

Title

Untitled (large group portrait of performers on stage)

People

Artist: Robert Burian, American active 1940s-1950s

Date

1946

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Indoors 99.2
Interior Design 99.2
Stage 98.7
Human 96.5
Person 96.5
Person 92.7
Crowd 89.7
Room 89.3
Screen 88.2
Electronics 88.2
Display 87
Monitor 87
Coat 86.1
Overcoat 86.1
Clothing 86.1
Suit 86.1
Apparel 86.1
Person 83.6
Audience 83.3
Person 83.2
Person 83.2
People 80.3
Theater 75.6
Hall 75.6
Auditorium 75.6
Dress 74.9
Person 74.3
Person 71.5
Chair 70.4
Furniture 70.4
Person 70.3
Person 69.8
Person 67.2
Kid 65.4
Child 65.4
TV 64.5
Television 64.5
Person 63.9
Female 61.5
Girl 61.5
Person 60.3
Court 59.9
School 57.6
Classroom 57.6
Person 45.9

Imagga
created on 2022-03-05

theater curtain 31.9
room 31.4
people 29
classroom 27.3
curtain 27.3
table 26
man 25.5
group 23.3
person 23.3
office 21.4
women 21.3
hall 20.8
meeting 20.7
business 20
male 19.8
teacher 19.5
blind 19.1
sitting 18.9
professional 17.8
interior 17.7
businessman 17.6
happy 17.5
work 17.2
team 16.1
job 15.9
smiling 15.9
suit 15.3
couple 14.8
corporate 14.6
chair 14.2
indoors 14
men 13.7
adult 13.6
student 13.4
modern 13.3
manager 13
education 13
protective covering 12.8
executive 12.7
conference 12.7
home 12
businesswoman 11.8
glass 11.7
portrait 11.6
stage 11.5
together 11.4
presentation 11.2
celebration 11.2
teamwork 11.1
indoor 10.9
communication 10.9
smile 10.7
restaurant 10.7
love 10.2
baron 10
desk 9.5
talking 9.5
blackboard 9.5
happiness 9.4
children 9.1
cheerful 8.9
class 8.7
school 8.5
house 8.3
window 8.3
worker 8.3
holding 8.2
board 8.1
educator 8.1
judge 7.9
design 7.9
drinking 7.6
performance 7.6
boss 7.6
classical 7.6
two 7.6
dining 7.6
dinner 7.6
study 7.5
wine 7.4
training 7.4
new 7.3
lifestyle 7.2
dress 7.2
day 7.1

Google
created on 2022-03-05

Textile 87.2
Style 84
Black-and-white 84
Font 81.7
Wall 80.8
Art 80.1
Monochrome 78.1
Rectangle 77.6
Monochrome photography 75.7
Event 72.6
Room 69.8
Entertainment 68.8
Curtain 68.2
Stock photography 63.8
Suit 63.5
Chair 60.4
Audio equipment 57.5
Visual arts 56
Team 55
Crowd 54.5

Microsoft
created on 2022-03-05

person 88.2
text 84.4
white 67.9
concert 51

Face analysis

Amazon

Google

AWS Rekognition

Age 10-18
Gender Male, 97.6%
Calm 99.2%
Angry 0.2%
Disgusted 0.1%
Surprised 0.1%
Sad 0.1%
Happy 0.1%
Confused 0.1%
Fear 0%

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Sad 39.6%
Disgusted 21.1%
Happy 9.9%
Confused 8%
Angry 6.6%
Fear 6.6%
Calm 4.7%
Surprised 3.4%

AWS Rekognition

Age 18-26
Gender Female, 94.4%
Happy 96.8%
Calm 1.1%
Sad 0.6%
Fear 0.4%
Confused 0.3%
Disgusted 0.3%
Surprised 0.2%
Angry 0.2%

AWS Rekognition

Age 29-39
Gender Male, 97.9%
Calm 71%
Sad 23.8%
Confused 1.8%
Angry 1.4%
Happy 0.9%
Disgusted 0.5%
Surprised 0.4%
Fear 0.3%

AWS Rekognition

Age 16-22
Gender Male, 92%
Calm 96.2%
Sad 2.7%
Happy 0.3%
Confused 0.2%
Angry 0.2%
Surprised 0.1%
Disgusted 0.1%
Fear 0.1%

AWS Rekognition

Age 6-14
Gender Female, 53.8%
Happy 64%
Calm 19.5%
Surprised 4.6%
Sad 4.5%
Fear 4%
Angry 1.7%
Confused 0.8%
Disgusted 0.8%

AWS Rekognition

Age 39-47
Gender Male, 63.5%
Calm 98.8%
Happy 0.7%
Sad 0.2%
Angry 0.1%
Disgusted 0.1%
Surprised 0.1%
Confused 0%
Fear 0%

AWS Rekognition

Age 26-36
Gender Female, 50.1%
Calm 98.3%
Happy 0.7%
Sad 0.4%
Confused 0.2%
Disgusted 0.1%
Angry 0.1%
Fear 0.1%
Surprised 0.1%

AWS Rekognition

Age 35-43
Gender Male, 75.3%
Sad 46.7%
Calm 32.8%
Confused 5.8%
Angry 4.2%
Disgusted 3.9%
Surprised 3.4%
Happy 1.7%
Fear 1.5%

AWS Rekognition

Age 38-46
Gender Male, 97.9%
Happy 97.4%
Calm 1.3%
Fear 0.4%
Surprised 0.3%
Angry 0.2%
Disgusted 0.2%
Sad 0.2%
Confused 0.1%

AWS Rekognition

Age 25-35
Gender Female, 90.5%
Sad 34.8%
Fear 18.3%
Disgusted 14.6%
Angry 10.8%
Happy 8.3%
Confused 7.8%
Calm 3.7%
Surprised 1.6%

AWS Rekognition

Age 19-27
Gender Female, 60.3%
Sad 35.6%
Happy 29.6%
Calm 23.9%
Fear 3.1%
Angry 2.5%
Disgusted 2.2%
Confused 1.7%
Surprised 1.6%

AWS Rekognition

Age 23-33
Gender Male, 63.5%
Happy 93.4%
Calm 3.1%
Sad 2%
Fear 0.6%
Surprised 0.5%
Angry 0.2%
Confused 0.2%
Disgusted 0.2%

AWS Rekognition

Age 27-37
Gender Female, 60%
Calm 41.5%
Happy 23%
Disgusted 18%
Fear 8.3%
Sad 4%
Angry 2.4%
Surprised 1.5%
Confused 1.4%

AWS Rekognition

Age 20-28
Gender Female, 98.2%
Calm 87.6%
Sad 10.4%
Happy 0.7%
Angry 0.4%
Confused 0.4%
Fear 0.2%
Disgusted 0.1%
Surprised 0.1%

AWS Rekognition

Age 7-17
Gender Female, 65.4%
Fear 55.8%
Calm 27.8%
Confused 7.4%
Happy 3.1%
Sad 2.1%
Disgusted 1.4%
Surprised 1.4%
Angry 0.9%

AWS Rekognition

Age 29-39
Gender Male, 89.3%
Calm 61.7%
Sad 13.5%
Happy 11.9%
Fear 5.8%
Disgusted 2.8%
Confused 2%
Angry 1.5%
Surprised 0.9%

AWS Rekognition

Age 4-12
Gender Female, 73.5%
Sad 89.8%
Calm 4.1%
Happy 1.6%
Confused 1.6%
Angry 0.8%
Disgusted 0.8%
Fear 0.8%
Surprised 0.5%

AWS Rekognition

Age 18-24
Gender Female, 82.6%
Happy 40.7%
Calm 29.1%
Sad 15.1%
Confused 4%
Surprised 3.1%
Disgusted 2.9%
Angry 2.6%
Fear 2.6%

AWS Rekognition

Age 42-50
Gender Female, 83.1%
Calm 94.7%
Sad 2.4%
Happy 1.9%
Confused 0.3%
Angry 0.2%
Disgusted 0.2%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 23-31
Gender Female, 79.7%
Calm 50.2%
Happy 28.4%
Confused 7.1%
Sad 6.3%
Fear 2.6%
Angry 2.3%
Disgusted 2.1%
Surprised 1.1%

AWS Rekognition

Age 18-24
Gender Male, 100%
Sad 80.9%
Confused 10.6%
Calm 4.3%
Angry 3%
Happy 0.4%
Surprised 0.3%
Fear 0.2%
Disgusted 0.2%

AWS Rekognition

Age 24-34
Gender Male, 90.9%
Calm 83.9%
Sad 5.2%
Happy 4.4%
Angry 2.2%
Confused 1.9%
Surprised 0.9%
Fear 0.8%
Disgusted 0.7%

AWS Rekognition

Age 13-21
Gender Female, 69%
Calm 40.7%
Sad 33.9%
Fear 11.7%
Confused 6.3%
Angry 4.7%
Happy 1.3%
Surprised 0.9%
Disgusted 0.6%

AWS Rekognition

Age 21-29
Gender Male, 97.9%
Sad 28%
Calm 25.1%
Happy 16.3%
Surprised 9.8%
Angry 8.9%
Confused 4.8%
Disgusted 4.6%
Fear 2.5%

AWS Rekognition

Age 34-42
Gender Male, 98.3%
Fear 54.6%
Sad 37.3%
Calm 4.5%
Angry 1.8%
Disgusted 0.8%
Confused 0.5%
Happy 0.3%
Surprised 0.2%

AWS Rekognition

Age 6-14
Gender Male, 97.4%
Surprised 47.8%
Fear 27.4%
Happy 7.8%
Calm 7.8%
Confused 4.7%
Angry 1.6%
Disgusted 1.5%
Sad 1.4%

AWS Rekognition

Age 14-22
Gender Female, 87.2%
Calm 50.1%
Sad 23.2%
Angry 9.9%
Fear 7.6%
Confused 3.4%
Happy 2.1%
Disgusted 2%
Surprised 1.7%

AWS Rekognition

Age 27-37
Gender Female, 99.6%
Calm 84.1%
Sad 4.9%
Happy 2.7%
Angry 2.6%
Disgusted 2.2%
Confused 2%
Fear 0.9%
Surprised 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 96.5%

Captions

Microsoft

a group of people standing in front of a window 83.1%
a group of people in front of a window 80.5%
a group of people standing next to a window 80.4%

Text analysis

Amazon

MJI7
S
125%
MJI7 ALSAN
ALSAN

Google

JIa
022MA
JIa YT33A2 022MA
YT33A2