Human Generated Data

Title

Untitled (men drinking at bar)
Date

c. 1950
People

Artist: Bachrach Studios, founded 1868
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18940

Human Generated Data

Title

Untitled (men drinking at bar)

People

Artist: Bachrach Studios, founded 1868

Date

c. 1950

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.18940

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Person 98
Human 98
Clothing 96.8
Apparel 96.8
Person 96.5
Person 92.8
Overcoat 92.2
Coat 92.2
Person 92.1
Suit 86.7
Tie 84.7
Accessories 84.7
Accessory 84.7
Bar Counter 82
Pub 82
Person 80.3
Person 78
Beverage 77.1
Drink 77.1
Crowd 73.5
Alcohol 73.1
Person 72.1
Shirt 69.5
Tuxedo 67.9
Indoors 67
Glass 65.4
Tie 62.8
Suit 62.3
People 57.6
Face 56.3
Bottle 56.2
Room 56
Person 54.1

Clarifai
created on 2023-10-22

people 99.8
group 98.8
group together 98.8
man 97.3
many 96.2
adult 95.5
woman 92.3
several 92
indoors 91.8
five 90.9
wear 88.6
leader 88.1
education 87.6
monochrome 85.6
recreation 85.4
room 81.1
school 80.9
uniform 80.8
military 79.2
musician 76.7

Imagga
created on 2022-03-05

man 40.3
businessman 34.4
business 34
male 32.6
professional 32.5
person 31.9
team 31.4
meeting 31.1
people 29
office 28.2
corporate 26.6
group 26.6
teamwork 26
happy 25.1
adult 24.9
men 23.2
job 22.1
work 22
businesswoman 20.9
smiling 20.3
doctor 19.7
hospital 19.7
medical 19.4
brass 18.9
teacher 18.6
colleagues 18.5
executive 18.1
worker 17.9
room 17.8
suit 17.1
women 16.6
occupation 16.5
wind instrument 16.2
businesspeople 16.1
table 15.6
diversity 15.4
nurse 15.1
life 15
care 14.8
standing 14.8
success 14.5
lifestyle 14.5
partnership 14.4
communication 14.3
talking 14.3
building 14.2
medicine 14.1
indoors 14.1
mature 13.9
couple 13.9
photographer 13.3
surgeon 13.3
working 13.3
manager 13
smile 12.8
musical instrument 12.8
diverse 12.7
discussion 12.7
staff 12.4
desk 12.3
together 12.3
education 12.1
patient 12.1
modern 11.9
successful 11.9
attractive 11.9
confident 11.8
health 11.8
happiness 11.8
clinic 11.5
company 11.2
20s 11
entrepreneur 11
indoor 11
coworkers 10.8
student 10.6
partner 10.6
corporation 10.6
mid adult 10.6
educator 10.5
ethnic 10.5
career 10.4
portrait 10.4
senior 10.3
sitting 10.3
trombone 10
stethoscope 10
associates 9.8
handsome 9.8
conference 9.8
businessmen 9.8
coat 9.7
40s 9.7
practitioner 9.7
profession 9.6
boss 9.6
cheerful 8.9
looking 8.8
workers 8.7
expertise 8.7
hands 8.7
case 8.5
adults 8.5
casual 8.5
friendly 8.2
cornet 8.2
computer 8
interior 8
sword 7.9
day 7.8
handshake 7.8
well dressed 7.8
color 7.8
middle aged 7.8
cooperation 7.7
uniform 7.6
presentation 7.4
technology 7.4
service 7.4
training 7.4
employee 7.3
board 7.2
home 7.2
bright 7.1

Google
created on 2022-03-05

Shirt 94.2
Black-and-white 84.1
Style 83.8
Monochrome photography 76.2
Monochrome 74.9
Event 73.7
White-collar worker 71.1
Tie 70.5
Cooking 70.1
Crew 70.1
Barware 69.7
Science 68.9
Service 68.4
Suit 66.1
Stock photography 65.4
Chemistry 62.4
Team 62.1
Job 61.8
Formal wear 59.3
Employment 58.1

Microsoft
created on 2022-03-05

person 99.4
man 96.9
clothing 96.4
standing 95
posing 91.6
text 86
black and white 82.1
black 69.4
smile 61.6

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 48-54
Gender Male, 100%
Sad 63.9%
Confused 21%
Happy 6.7%
Disgusted 2.6%
Calm 1.7%
Surprised 1.6%
Angry 1.3%
Fear 1.2%

AWS Rekognition

Age 34-42
Gender Male, 100%
Sad 88.5%
Calm 3.8%
Happy 2.3%
Angry 2.3%
Confused 2.3%
Disgusted 0.5%
Fear 0.2%
Surprised 0.1%

AWS Rekognition

Age 50-58
Gender Male, 99.8%
Happy 92.7%
Confused 2.1%
Disgusted 1.7%
Sad 1.3%
Angry 0.8%
Surprised 0.8%
Calm 0.3%
Fear 0.3%

AWS Rekognition

Age 50-58
Gender Male, 71.1%
Sad 37.6%
Calm 37%
Happy 15.1%
Confused 4.2%
Surprised 3%
Fear 1.4%
Disgusted 1%
Angry 0.7%

AWS Rekognition

Age 48-54
Gender Male, 99.9%
Surprised 30.7%
Happy 15.2%
Sad 14%
Disgusted 11.2%
Calm 9.1%
Confused 9.1%
Angry 8.3%
Fear 2.5%

AWS Rekognition

Age 30-40
Gender Male, 99.4%
Calm 56.8%
Sad 38.9%
Confused 1.6%
Angry 1.1%
Disgusted 0.6%
Surprised 0.4%
Fear 0.3%
Happy 0.2%

AWS Rekognition

Age 41-49
Gender Male, 99.7%
Calm 56.4%
Sad 35.4%
Happy 3%
Confused 1.6%
Disgusted 1.2%
Surprised 1.2%
Fear 0.8%
Angry 0.4%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person
Suit
Tie
Person 98%
Person 96.5%
Person 92.8%
Person 92.1%
Person 80.3%
Person 78%
Person 72.1%
Person 54.1%
Suit 86.7%
Suit 62.3%
Tie 84.7%
Tie 62.8%

Categories

Imagga

people portraits 55.5%
events parties 43.3%

Text analysis

Amazon

43
LIFW
3.3
VERA
sion
KODAK--SELA LIFW
KODAK--SELA
HARGET