Human Generated Data

Title

Untitled (guests chatting at paper company party)

Date

1950

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9338

Human Generated Data

Title

Untitled (guests chatting at paper company party)

People

Artist: Martin Schweig, American 20th century

Date

1950

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.7
Person 99.7
Person 99.1
Person 99
Person 98.9
Person 98.5
Person 98
Apparel 97.6
Clothing 97.6
Person 96.5
Person 96
Person 95.9
Person 95.4
Indoors 81.8
Accessories 80.5
Accessory 80.5
Sunglasses 80.5
Clinic 71.5
Crowd 71.4
Interior Design 70.6
Suit 70.5
Coat 70.5
Overcoat 70.5
Gown 69.8
Fashion 69.8
Robe 69.1
Person 62.7
Reception 62.1
Furniture 62.1
Room 60.9
Wedding 59.9
Flooring 59.7
Wedding Gown 57.8
Sleeve 55.8
Waiting Room 55.7
Reception Room 55.2

Imagga
created on 2022-01-23

teacher 42.1
people 36.8
person 35.2
man 32.2
male 31.2
business 30.4
meeting 29.2
group 29
professional 28.8
adult 28.4
office 27.8
hall 27.7
room 27.6
educator 27.4
businessman 27.4
table 26
executive 25.3
smiling 23.1
indoors 22.8
work 20.4
corporate 19.8
men 19.7
interior 19.4
happy 19.4
sitting 18.9
colleagues 18.5
women 18.2
team 17.9
businesswoman 17.3
teamwork 16.7
indoor 16.4
classroom 16.3
student 16.3
desk 16.1
communication 16
together 15.8
education 15.6
modern 15.4
restaurant 15
couple 14.8
suit 14.4
home 14.3
businesspeople 14.2
life 14
cheerful 13.8
entrepreneur 13.4
worker 13.4
computer 12.8
chair 12.4
working 12.4
lifestyle 12.3
senior 12.2
happiness 11.7
conference 11.7
clothing 11.7
talking 11.4
smile 11.4
mature 11.2
laptop 10.9
job 10.6
mid adult 10.6
presentation 10.2
nurse 10.2
occupation 10.1
board 9.9
coworkers 9.8
40s 9.7
discussion 9.7
corporation 9.7
looking 9.6
design 9.6
manager 9.3
patient 9.1
portrait 9.1
color 8.9
diverse 8.8
businessmen 8.8
enrollee 8.7
30s 8.7
diversity 8.6
adults 8.5
career 8.5
clothes 8.4
horizontal 8.4
coffee 8.3
inside 8.3
technology 8.2
class 7.7
casual 7.6
workplace 7.6
holding 7.4
service 7.4
training 7.4
hospital 7.3
success 7.2
bright 7.1
face 7.1
to 7.1

Google
created on 2022-01-23

Photograph 94.2
Black 89.7
Coat 89.5
Black-and-white 87.3
Style 84.1
Line 82
Monochrome 77.4
Suit 77
Monochrome photography 76.7
Snapshot 74.3
Font 74.2
Crowd 73.5
Event 73.3
Formal wear 71.6
Room 71.3
White-collar worker 70.4
Stock photography 64
Team 62.7
History 59.5
Ceremony 56.2

Microsoft
created on 2022-01-23

person 99.6
clothing 90.4
people 87.3
woman 81
man 80
group 78.1
black and white 57.4

Face analysis

Amazon

Google

AWS Rekognition

Age 23-31
Gender Female, 79.2%
Calm 41.8%
Fear 21.2%
Sad 20.6%
Happy 9%
Angry 2.4%
Surprised 2.3%
Disgusted 2.2%
Confused 0.5%

AWS Rekognition

Age 26-36
Gender Male, 100%
Sad 67.7%
Happy 11.7%
Calm 11.5%
Confused 3.4%
Disgusted 2.3%
Angry 1.5%
Fear 1.2%
Surprised 0.7%

AWS Rekognition

Age 21-29
Gender Female, 94.6%
Calm 99.7%
Surprised 0.1%
Sad 0.1%
Confused 0.1%
Happy 0%
Disgusted 0%
Fear 0%
Angry 0%

AWS Rekognition

Age 9-17
Gender Male, 60.5%
Calm 67.2%
Confused 16%
Sad 11.7%
Surprised 1.4%
Happy 1.1%
Disgusted 1%
Angry 0.8%
Fear 0.7%

AWS Rekognition

Age 36-44
Gender Male, 97%
Calm 96.8%
Surprised 1.2%
Happy 0.5%
Sad 0.4%
Angry 0.4%
Fear 0.3%
Disgusted 0.2%
Confused 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%
Sunglasses 80.5%

Captions

Microsoft

a group of people standing in front of a crowd 97.6%
a group of people standing in a room 97.5%
a group of people standing in front of a crowd of people 97.4%

Text analysis

Amazon

PRE