Human Generated Data

Title

Untitled (portrait of husband and wife in corner of room with woman wearing fur-lined coat and black hat)
Date

1935, printed later
People

Artist: Martin Schweig, American 20th century
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.10246

Human Generated Data

Title

Untitled (portrait of husband and wife in corner of room with woman wearing fur-lined coat and black hat)

People

Artist: Martin Schweig, American 20th century

Date

1935, printed later

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-11-16

Human 99
Person 99
Person 98.3
Clothing 95.6
Apparel 95.6
Sitting 94
Person 90.8
Tie 89.6
Accessories 89.6
Accessory 89.6
Performer 88
Coat 80.9
Overcoat 80.9
Suit 78.7
Photography 61
Photo 61
Portrait 61
Face 61
Female 60
Advertisement 56.3
Collage 56.3
Poster 56.3
Text 56
Photo Booth 55.8

Clarifai
created on 2019-11-16

people 99.9
group 99.4
adult 97.8
group together 97.4
actor 96.8
man 96.8
woman 96.8
movie 95.9
leader 93.4
portrait 92.4
actress 92.4
room 92
outfit 92
three 91.8
television 91.1
music 90.9
wear 89.5
administration 88.8
musician 88.1
four 88

Imagga
created on 2019-11-16

bow tie 73.6
necktie 60.8
businessman 54.8
man 54.5
office 52.5
business 49.2
suit 43.7
male 42.6
corporate 40.4
professional 37
people 35.2
garment 34.6
executive 33.4
meeting 32
businesswoman 31.8
team 30.5
person 30.2
work 29.1
adult 28.1
businesspeople 27.5
group 26.6
men 25.8
happy 24.4
teamwork 24.1
job 23.9
confident 22.8
sitting 21.5
handsome 21.4
smile 20.7
manager 20.5
businessmen 20.5
clothing 19.9
success 19.3
building 19.2
formal 19.1
tie 19
communication 18.5
colleagues 18.5
successful 18.3
groom 17.8
career 17
looking 16.8
attractive 16.8
happiness 16.5
partner 16.4
partnership 16.3
portrait 16.2
desk 16.1
working 15.9
indoor 15.5
corporation 15.4
boss 15.3
company 14.9
mature 14.9
standing 14.8
computer 14.5
women 14.2
modern 14
smiling 13.7
diverse 13.7
workplace 13.3
employee 13.1
laptop 12.9
diversity 12.5
talking 12.4
together 12.3
cheerful 12.2
worker 12
busy 11.6
couple 11.3
room 11.2
black 11.1
occupation 11
jacket 10.8
partners 10.7
leadership 10.6
expression 10.2
two 10.2
20s 10.1
coworkers 9.8
businessperson 9.8
workers 9.7
table 9.5
ethnic 9.5
secretary 9.5
lifestyle 9.4
casual 9.3
face 9.2
holding 9.1
businesswomen 8.8
indoors 8.8
discussion 8.8
40s 8.8
showing 8.4
horizontal 8.4
alone 8.2
entrepreneur 8.2
lady 8.1
love 7.9
discussing 7.9
education 7.8
planning 7.7
30s 7.7
pretty 7.7
staff 7.7
elevator 7.6
interior 7.1

Google
created on 2019-11-16

Photograph 96.2
Snapshot 84.1
Black-and-white 80.7
Photography 75.7
Picture frame 75.1
Room 71.4
Gentleman 66.5
Monochrome 64.3
Portrait 55.1
Style 51
Art 50.2

Microsoft
created on 2019-11-16

text 99.6
clothing 98
person 96.1
man 95.6
human face 95.3
smile 93.9
black 92
standing 89.1
woman 84.7
gallery 81.9
suit 71.9
black and white 69.9
white 66.9
posing 65.1
coat 55.9
room 43.9
silhouette 22.3
picture frame 9.9

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 26-40
Gender Male, 99.1%
Fear 0%
Calm 94.1%
Surprised 0.1%
Confused 0.7%
Disgusted 0.2%
Happy 3.7%
Sad 0.2%
Angry 1%

AWS Rekognition

Age 24-38
Gender Female, 94.4%
Happy 2%
Angry 0.4%
Disgusted 0.3%
Sad 0.2%
Surprised 0.5%
Calm 96.4%
Fear 0.1%
Confused 0.2%

AWS Rekognition

Age 24-38
Gender Female, 82.4%
Sad 0.3%
Surprised 0.6%
Angry 0.5%
Confused 0.2%
Fear 0.1%
Happy 2.6%
Calm 95.4%
Disgusted 0.3%

Microsoft Cognitive Services

Age 44
Gender Female

Microsoft Cognitive Services

Age 41
Gender Male

Microsoft Cognitive Services

Age 48
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99%
Tie 89.6%
Suit 78.7%

Captions

Microsoft

a man standing in front of a group of people posing for a photo 88.6%
a black and white photo of a man 88.5%
a man standing in front of a group of people posing for the camera 88.4%