Human Generated Data

Title

Untitled (seven men posing at banquet table in brewing company)
Date

1948
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9199

Human Generated Data

Title

Untitled (seven men posing at banquet table in brewing company)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.1
Person 98.9
Person 98.8
Person 97.4
Person 95
Person 94
Furniture 91
Clothing 89
Apparel 89
Person 86.3
Person 85
Glass 84.8
Table 83
Dining Table 82.7
Sitting 80
Tie 79.1
Accessories 79.1
Accessory 79.1
Bar Counter 74
Pub 74
Dating 71.1
Alcohol 69.5
Beverage 69.5
Drink 69.5
Sunglasses 68.6
Tabletop 67.5
Bottle 66.3
Suit 65.2
Overcoat 65.2
Coat 65.2
Restaurant 63
Portrait 60.1
Photography 60.1
Face 60.1
Photo 60.1
Meal 59.7
Food 59.7
Scientist 56.1
Chair 50.4

Imagga
created on 2022-01-23

room 51.9
classroom 50.9
man 39
business 36.4
male 35.5
office 34.6
businessman 34.4
meeting 33
people 31.8
person 29.2
group 29
table 28.6
businesswoman 26.3
brass 25.2
work 24.3
team 24.2
men 24
communication 23.5
wind instrument 23.5
colleagues 23.3
adult 23.2
sitting 23.2
musical instrument 23
happy 22.6
teamwork 22.2
businesspeople 21.8
professional 21.5
executive 21.5
corporate 21.5
together 20.2
talking 20
smiling 19.5
desk 18.9
women 18.2
teacher 17.7
indoors 17.6
laptop 17.5
computer 16.9
job 16.8
working 16.8
worker 16.6
cheerful 16.3
modern 16.1
chair 16.1
conference 14.7
discussion 14.6
hall 14.6
interior 14.2
education 13.9
sax 13.8
suit 13.5
smile 12.8
discussing 12.8
mature 12.1
confident 11.8
coworkers 11.8
happiness 11.8
percussion instrument 11.7
workplace 11.4
couple 11.3
manager 11.2
casual 11
20s 11
indoor 11
lifestyle 10.8
presentation 10.2
successful 10.1
associates 9.8
cooperation 9.7
success 9.7
technology 9.6
30s 9.6
four 9.6
student 9.3
restaurant 9.3
portrait 9.1
board 9
nurse 8.9
handsome 8.9
marimba 8.8
looking 8.8
businessmen 8.8
40s 8.8
building 8.7
corporation 8.7
employee 8.6
career 8.5
color 8.3
occupation 8.2
collaboration 7.9
diverse 7.8
device 7.8
colleague 7.8
conversation 7.8
staff 7.8
class 7.7
busy 7.7
diversity 7.7
boss 7.6
two 7.6
ethnic 7.6
friends 7.5
learning 7.5
company 7.4
document 7.4
cornet 7.3
home 7.2
love 7.1
day 7.1

Google
created on 2022-01-23

Black 89.6
Coat 88.8
Style 83.9
Black-and-white 83.6
Table 80
Suit 79.1
Font 78.4
Chair 76.2
Monochrome 73.6
Monochrome photography 73.6
Event 69.3
White-collar worker 69
Crew 66.6
Room 65.8
Recreation 65.7
Sitting 65.3
History 63.8
Vintage clothing 63.4
Team 63.2
Stock photography 62.5

Microsoft
created on 2022-01-23

table 98.9
person 97.5
text 93.7
bottle 86
man 85.7
furniture 82.3
clothing 78.3
black and white 74.7
people 71
chair 60.3

Face analysis

Amazon

Google

AWS Rekognition

Age 33-41
Gender Male, 100%
Calm 41.4%
Angry 35%
Confused 9.3%
Sad 6.6%
Disgusted 4.1%
Surprised 2.6%
Fear 0.6%
Happy 0.4%

AWS Rekognition

Age 41-49
Gender Male, 96.6%
Surprised 90.6%
Sad 3.6%
Calm 2.8%
Angry 0.8%
Happy 0.8%
Disgusted 0.7%
Confused 0.4%
Fear 0.3%

AWS Rekognition

Age 48-54
Gender Female, 90.2%
Happy 92.7%
Surprised 4.5%
Calm 1.5%
Disgusted 0.4%
Angry 0.3%
Sad 0.3%
Fear 0.2%
Confused 0.2%

AWS Rekognition

Age 51-59
Gender Male, 100%
Calm 99.7%
Sad 0.1%
Confused 0.1%
Surprised 0%
Happy 0%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 43-51
Gender Male, 99%
Calm 98%
Sad 1%
Happy 0.4%
Confused 0.2%
Surprised 0.2%
Disgusted 0.1%
Angry 0%
Fear 0%

AWS Rekognition

Age 39-47
Gender Male, 98.6%
Sad 31.6%
Happy 16.1%
Angry 15.1%
Confused 14.4%
Calm 13.6%
Surprised 3.7%
Fear 2.8%
Disgusted 2.6%

AWS Rekognition

Age 52-60
Gender Female, 59%
Happy 64.5%
Surprised 23.4%
Confused 6.7%
Sad 1.7%
Calm 1.3%
Disgusted 0.9%
Fear 0.8%
Angry 0.6%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.5%
Tie 79.1%
Sunglasses 68.6%
Chair 50.4%

Captions

Microsoft

a group of people standing in front of a building 91.4%
a group of people standing in front of a window 85.6%
a group of people standing around a table 85.5%

Text analysis

Amazon

ENERAL
13551
SI
EEI
KODVK-&VEELA

Google

MLY
MLY