Human Generated Data

Title

Untitled (six men posed at table displaying beer bottles and cigars and banquet room filled with tables and people)

Date

1948

People

Artist: Martin Schweig, American 20th century

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9194

Human Generated Data

Title

Untitled (six men posed at table displaying beer bottles and cigars and banquet room filled with tables and people)

People

Artist: Martin Schweig, American 20th century

Date

1948

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.9194

Machine Generated Data

Tags

Amazon
created on 2022-01-23

Person 99.5
Human 99.5
Person 99.3
Person 99.1
Person 99.1
Person 98.8
Person 97.9
Person 96.3
Person 95.9
Clothing 90.1
Helmet 90.1
Apparel 90.1
Clinic 89.1
Person 85.1
Bottle 84.5
Beverage 82.4
Drink 82.4
Tie 79.8
Accessory 79.8
Accessories 79.8
Bar Counter 73.9
Pub 73.9
Person 73
Alcohol 71.4
Sunglasses 65.2
Sunglasses 64.4
Room 62.6
Indoors 62.6
Operating Theatre 59.2
Hospital 59.2
Glass 57.3
Person 52.3

Clarifai
created on 2023-10-26

people 99.7
adult 98.6
group together 98.2
man 97.7
group 97.6
many 95
waiter 90.6
several 88.4
monochrome 88
furniture 86.6
restaurant 84.8
woman 84.4
wear 83.8
indoors 81.2
education 80.6
chair 79.1
leader 76.2
facial expression 75.2
administration 74.9
five 74.3

Imagga
created on 2022-01-23

patient 57.6
person 55.2
man 42.3
case 41.3
sick person 40.1
nurse 34.9
male 34
people 34
adult 25.4
business 24.9
businessman 24.7
marimba 22.7
indoors 21.1
room 20.8
percussion instrument 20.4
computer 20.1
meeting 19.8
sitting 19.8
professional 19.7
smiling 19.5
office 19.5
working 19.4
group 19.3
desk 18.9
work 18.8
worker 18.7
education 18.2
table 18.2
happy 18.2
businesspeople 18
teacher 18
musical instrument 17.6
classroom 16.3
men 16.3
colleagues 15.5
businesswoman 15.4
color 14.5
lifestyle 14.5
team 14.3
teamwork 13.9
cheerful 13.8
occupation 13.7
communication 13.4
medical 13.2
lab coat 12.9
day 12.6
hospital 12.4
interior 12.4
together 12.3
home 12
indoor 11.9
happiness 11.8
horizontal 11.7
40s 11.7
mid adult 11.6
coat 11.6
job 11.5
corporate 11.2
women 11.1
casual 11
class 10.6
30s 10.6
talking 10.5
doctor 10.3
keyboard 10.3
laptop 10.3
executive 10.2
student 10
board 9.9
hand 9.9
specialist 9.8
conference 9.8
monitor 9.8
looking 9.6
couple 9.6
adults 9.5
senior 9.4
clothing 9.1
suit 9
handsome 8.9
restaurant 8.9
coworkers 8.8
discussion 8.8
chair 8.7
smile 8.6
enjoyment 8.4
study 8.4
health 8.3
holding 8.3
20s 8.2
educator 7.8
two people 7.8
portrait 7.8
modern 7.7
angle 7.7
four 7.7
workplace 7.6
college 7.6
screen 7.5
technology 7.4
care 7.4
focus 7.4
camera 7.4
successful 7.3
friendly 7.3
confident 7.3
employee 7.3
medicine 7

Microsoft
created on 2022-01-23

person 99.8
bottle 93.5
man 90.2
text 85.9
clothing 70.4

Color Analysis

Face analysis

Amazon

Google

AWS Rekognition

Age 30-40
Gender Male, 99.1%
Calm 96.2%
Sad 2%
Happy 0.7%
Confused 0.3%
Surprised 0.3%
Disgusted 0.3%
Angry 0.2%
Fear 0.1%

AWS Rekognition

Age 54-62
Gender Male, 97.9%
Calm 49.8%
Sad 20.4%
Surprised 16.9%
Confused 5.2%
Disgusted 3.9%
Happy 2.6%
Angry 0.9%
Fear 0.4%

AWS Rekognition

Age 50-58
Gender Male, 99.6%
Calm 99.6%
Sad 0.2%
Happy 0.1%
Confused 0.1%
Surprised 0.1%
Disgusted 0%
Angry 0%
Fear 0%

AWS Rekognition

Age 47-53
Gender Male, 99.9%
Confused 54.2%
Sad 13.7%
Happy 10.2%
Calm 9.5%
Surprised 5.2%
Angry 4.3%
Disgusted 2.5%
Fear 0.4%

AWS Rekognition

Age 39-47
Gender Male, 94.7%
Calm 99.1%
Happy 0.4%
Confused 0.2%
Surprised 0.1%
Sad 0.1%
Disgusted 0.1%
Fear 0%
Angry 0%

AWS Rekognition

Age 34-42
Gender Male, 99.9%
Calm 75.6%
Confused 16.8%
Surprised 2.6%
Happy 2.5%
Sad 1.4%
Disgusted 0.9%
Fear 0.1%
Angry 0.1%

AWS Rekognition

Age 23-33
Gender Female, 78.2%
Sad 50.2%
Calm 35.2%
Confused 4.7%
Disgusted 4.6%
Angry 1.7%
Happy 1.7%
Surprised 1.1%
Fear 0.9%

AWS Rekognition

Age 24-34
Gender Male, 94.1%
Calm 92.8%
Fear 2.4%
Sad 1.4%
Angry 1.1%
Disgusted 0.9%
Happy 0.8%
Confused 0.4%
Surprised 0.2%

AWS Rekognition

Age 23-33
Gender Female, 50%
Calm 52.8%
Sad 37.6%
Surprised 1.8%
Confused 1.8%
Happy 1.7%
Fear 1.5%
Angry 1.4%
Disgusted 1.4%

AWS Rekognition

Age 19-27
Gender Male, 77.8%
Sad 78%
Happy 8.5%
Calm 7.2%
Confused 3.1%
Fear 1.1%
Surprised 0.7%
Angry 0.7%
Disgusted 0.6%

AWS Rekognition

Age 18-26
Gender Male, 95.3%
Happy 60.6%
Calm 21.4%
Fear 5.7%
Angry 5.1%
Sad 4%
Surprised 1.4%
Confused 1%
Disgusted 0.8%

AWS Rekognition

Age 27-37
Gender Male, 78.2%
Calm 99.7%
Sad 0.1%
Surprised 0.1%
Confused 0%
Disgusted 0%
Fear 0%
Happy 0%
Angry 0%

AWS Rekognition

Age 24-34
Gender Male, 56.6%
Sad 63.3%
Calm 17.6%
Happy 5.5%
Angry 3.9%
Confused 3.9%
Surprised 2.2%
Disgusted 2.2%
Fear 1.5%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very likely

Feature analysis

Amazon

Person 99.5%
Helmet 90.1%
Tie 79.8%
Sunglasses 65.2%

Categories

Imagga

events parties 72.8%
people portraits 26.1%

Text analysis

Amazon

PHILLIES
Alpen
pen
Alpe
en
CIGA
ИТ ВА Alpen
Bras
Ipen
Grau
did
13551
PER
ИТ ВА
Alpelar
up
and up
and

Google

PHILLIES
PHILLIES