Human Generated Data

Title

Untitled (eight men standing around and drinking inside beer brewing plant)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9185

Human Generated Data

Title

Untitled (eight men standing around and drinking inside beer brewing plant)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Human 99.8
Person 99.8
Person 99.6
Person 99.4
Person 98.2
Person 98.1
Person 98
Person 94.7
Apparel 87.8
Clothing 87.8
Flooring 68.4
Building 65.8
People 64.2
Crowd 62.9
Coat 60.1
Suit 60.1
Overcoat 60.1
Sleeve 59.6
Priest 55.5

Imagga
created on 2022-01-23

turnstile 100
gate 100
movable barrier 74
barrier 49.2
people 27.3
business 25.5
obstruction 24.8
work 20.4
man 20.2
male 19.1
adult 18.3
building 18.1
men 17.2
industry 15.4
architecture 14.8
corporate 13.7
transportation 13.4
women 13.4
modern 13.3
couple 13.1
office 12.5
businessman 12.4
station 11.6
worker 11.3
professional 11.3
group 11.3
happy 11.3
travel 11.3
two 11
person 10.9
dress 10.8
urban 10.5
groom 10.4
hall 10
team 9.9
job 9.7
bride 9.6
day 9.4
clothing 9.2
wedding 9.2
city 9.1
businesswoman 9.1
suit 9
departure 8.9
interior 8.8
train 8.8
businesspeople 8.5
meeting 8.5
life 8.4
manager 8.4
new 8.1
success 8
family 8
smiling 8
indoors 7.9
happiness 7.8
standing 7.8
black 7.8
portrait 7.8
factory 7.7
old 7.7
casual 7.6
power 7.5
fashion 7.5
human 7.5
industrial 7.3
lifestyle 7.2
love 7.1
boutique 7

Google
created on 2022-01-23

Sleeve 87.2
Gesture 85.2
Headgear 82.7
Black-and-white 82.6
Line 81.6
Monochrome photography 75.2
Crew 74.6
Monochrome 74.5
Snapshot 74.3
Uniform 73.7
Font 71.1
T-shirt 68.1
Team 67.4
Room 66.4
Workwear 65.7
Event 64.2
Retail 55.7
Hat 54.4
Personal protective equipment 53.2
Fashion design 52.9

Microsoft
created on 2022-01-23

text 99.1
clothing 89.7
person 81.5
man 51.7

Face analysis

Amazon

Google

AWS Rekognition

Age 43-51
Gender Male, 99.8%
Calm 93.1%
Confused 3.1%
Sad 2.1%
Disgusted 0.6%
Angry 0.5%
Happy 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 41-49
Gender Male, 99.9%
Calm 78.4%
Happy 14.2%
Sad 3.9%
Confused 2.6%
Angry 0.4%
Disgusted 0.3%
Surprised 0.2%
Fear 0.1%

AWS Rekognition

Age 48-56
Gender Male, 100%
Surprised 46.5%
Happy 25%
Calm 15.7%
Sad 5.4%
Confused 2.8%
Disgusted 1.9%
Angry 1.5%
Fear 1.2%

AWS Rekognition

Age 56-64
Gender Male, 77.8%
Calm 91.1%
Disgusted 3%
Surprised 1.4%
Sad 1.3%
Confused 1%
Happy 1%
Angry 0.9%
Fear 0.3%

AWS Rekognition

Age 49-57
Gender Male, 99%
Sad 52.2%
Happy 25.7%
Surprised 14.3%
Calm 3.6%
Confused 1.9%
Disgusted 1%
Angry 0.9%
Fear 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Possible
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Likely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.8%
Suit 60.1%

Captions

Microsoft

a group of people standing in front of a window 85.9%
a group of people standing in front of a building 85.8%
a group of people standing in front of a store window 81.8%

Text analysis

Amazon

٢٢٨
54
YTOHA2-XAQOX