Human Generated Data

Title

Untitled (ten guests sitting at Bar Mitzvah banquet table)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9224

Human Generated Data

Title

Untitled (ten guests sitting at Bar Mitzvah banquet table)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 98.5
Human 98.5
Person 98.3
Person 98.3
Person 98.2
Person 98.2
Person 98.1
Person 98.1
Person 96.7
Accessories 96.6
Accessory 96.6
Tie 96.6
Person 95.8
Person 86.7
Person 79.8
Room 75.1
Indoors 75.1
Person 73.6
Person 71.3
Person 70.5
People 68.1
Furniture 66.6
Meal 66.2
Food 66.2
Table 65.9
Hat 64.5
Clothing 64.5
Apparel 64.5
Crowd 62.2
Clinic 61
Classroom 58.2
School 58.2
Restaurant 57.8
Cafeteria 57.8
Photo 57.2
Photography 57.2
Face 57.2
Portrait 57.2
Drawing 56.5
Art 56.5
Dining Table 55.1
Person 50.8

Imagga
created on 2022-01-23

room 36.2
office 34.5
people 32.9
man 32.3
person 32.1
table 30.6
male 30.5
business 30.4
businessman 30
meeting 29.2
adult 27.5
professional 25.2
work 25.1
team 25.1
group 25
men 24.9
teacher 23.4
desk 22.9
indoors 22.8
businesswoman 22.7
women 21.4
computer 20.9
sitting 20.6
businesspeople 19.9
executive 19.6
working 19.4
together 19.3
corporate 18.9
smiling 18.8
classroom 18.7
teamwork 18.5
worker 17.9
communication 17.6
home 17.5
colleagues 17.5
talking 17.1
happy 16.9
laptop 16.9
interior 15
modern 14.7
indoor 14.6
hall 14.3
couple 13.9
cheerful 13.8
smile 13.5
manager 13
educator 12.9
conference 12.7
chair 12.4
job 12.4
student 11.9
confident 11.8
mature 11.2
lifestyle 10.8
entrepreneur 10.7
workplace 10.5
portrait 10.4
presentation 10.2
happiness 10.2
glass 10.1
successful 10.1
nurse 10.1
suit 9.9
discussion 9.7
restaurant 9.7
education 9.5
friendship 9.4
board 9.2
brass 9.1
handsome 8.9
collaboration 8.9
success 8.9
coworkers 8.8
life 8.8
casual clothing 8.8
looking 8.8
40s 8.8
mid adult 8.7
leader 8.7
30s 8.7
center 8.6
clothing 8.6
casual 8.5
occupation 8.2
hospital 8.1
associates 7.9
discussing 7.9
employee 7.9
salon 7.8
dinner 7.8
partners 7.8
wind instrument 7.7
couch 7.7
boss 7.7
hand 7.6
career 7.6
friends 7.5
senior 7.5
company 7.4
holding 7.4
technology 7.4
color 7.2
medical 7.1

Google
created on 2022-01-23

Microsoft
created on 2022-01-23

text 99.2
table 98.5
clothing 93
book 92.1
man 91
person 89.6
window 88.2
old 75.4
furniture 62.9
group 59.2
posing 52

Face analysis

Amazon

Google

AWS Rekognition

Age 50-58
Gender Male, 85.8%
Calm 94.8%
Confused 4.3%
Disgusted 0.5%
Sad 0.2%
Surprised 0.1%
Happy 0.1%
Angry 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Male, 92.8%
Sad 47%
Calm 17.5%
Confused 15.1%
Disgusted 6.3%
Angry 5.6%
Happy 5.2%
Surprised 2.2%
Fear 1.1%

AWS Rekognition

Age 54-64
Gender Female, 61.1%
Happy 87.7%
Sad 6%
Angry 2.6%
Calm 1.3%
Fear 0.8%
Confused 0.7%
Surprised 0.5%
Disgusted 0.3%

AWS Rekognition

Age 38-46
Gender Male, 99.9%
Sad 74.4%
Calm 15.7%
Confused 7.6%
Happy 0.8%
Angry 0.6%
Disgusted 0.5%
Fear 0.3%
Surprised 0.3%

AWS Rekognition

Age 25-35
Gender Male, 82.1%
Calm 80.5%
Confused 7.8%
Sad 5.9%
Angry 2%
Happy 1.5%
Disgusted 0.9%
Surprised 0.8%
Fear 0.7%

AWS Rekognition

Age 53-61
Gender Male, 98.6%
Calm 49.2%
Confused 34.4%
Angry 6.7%
Sad 5.4%
Disgusted 1.5%
Surprised 1.4%
Happy 0.8%
Fear 0.6%

AWS Rekognition

Age 53-61
Gender Female, 69.8%
Calm 64.6%
Happy 32%
Surprised 1%
Angry 0.7%
Confused 0.5%
Disgusted 0.4%
Fear 0.4%
Sad 0.4%

AWS Rekognition

Age 37-45
Gender Male, 88.3%
Calm 94.3%
Sad 3.4%
Confused 1.4%
Happy 0.4%
Angry 0.1%
Fear 0.1%
Surprised 0.1%
Disgusted 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 98.5%
Tie 96.6%
Hat 64.5%

Captions

Microsoft

a group of people posing for a photo 85.4%
an old photo of a group of people posing for the camera 82.7%
a group of people posing for the camera 82.6%

Text analysis

Amazon

13805
EIEW
DUSCO SVEELA EIEW
SVEELA
DUSCO

Google

38
5
38 0 5
0