Human Generated Data

Title

Untitled (two men standing in front of portrait painting)

Date

1951

People

Artist: Peter James Studio, American

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20051

Human Generated Data

Title

Untitled (two men standing in front of portrait painting)

People

Artist: Peter James Studio, American

Date

1951

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Accessories 99.7
Accessory 99.7
Tie 99.7
Person 99.3
Human 99.3
Clothing 98.6
Apparel 98.6
Person 97.9
Person 94
Suit 92.2
Overcoat 92.2
Coat 92.2
Face 81
Tie 76.2
Shirt 75.7
Art 69.4
Portrait 66.6
Photography 66.6
Photo 66.6
Man 65.8
Sleeve 65.4
Long Sleeve 65.4
Drawing 63
Door 62.5
Floor 59.3
Home Decor 57.8
Pants 56.2

Imagga
created on 2022-03-05

man 28.2
male 25.5
old 22.3
person 21.3
people 20.1
executive 19.7
senior 18.7
adult 18.6
statue 17.9
business 15.2
grandfather 15.1
businessman 15
building 14.1
indoors 14.1
professional 14.1
couple 13.9
clothing 13.8
men 13.7
worker 13.6
home 13.6
religion 13.4
elderly 13.4
catholic 13.2
historical 13.2
monument 13.1
office 13
architecture 12.6
happy 12.5
corporate 12
inside 12
room 12
sculpture 11.8
nurse 11.7
history 11.6
vestment 11.6
ancient 11.2
church 11.1
gown 10.6
day 10.2
happiness 10.2
aged 10
70s 9.8
family 9.8
medical 9.7
marble 9.7
god 9.6
sitting 9.4
work 9.4
lifestyle 9.4
mature 9.3
stone 9.3
camera 9.2
art 9.2
waiter 9.2
historic 9.2
portrait 9.1
care 9
job 8.8
looking 8.8
40s 8.8
women 8.7
standing 8.7
smiling 8.7
employee 8.6
businesspeople 8.5
two 8.5
religious 8.4
health 8.3
tourism 8.3
indoor 8.2
teacher 8.1
group 8.1
patient 8
interior 8
antique 7.8
colleagues 7.8
retired 7.8
life 7.7
30s 7.7
casual 7.6
suit 7.6
career 7.6
famous 7.4
teamwork 7.4
cheerful 7.3
color 7.2
love 7.1
travel 7

Google
created on 2022-03-05

Photograph 94.2
Suit trousers 93.8
Black 89.5
Coat 89.2
Sleeve 87.2
Standing 86.4
Style 83.9
Collar 83.6
Suit 83.6
Black-and-white 83.2
Overcoat 82.7
Headgear 82.1
Art 81.7
Pantsuit 80
Blazer 78.3
Formal wear 76.3
Fashion design 74.9
Monochrome photography 74.9
Classic 74
Monochrome 72.6

Microsoft
created on 2022-03-05

person 99.7
clothing 97.2
man 93.9
smile 85.5
human face 73.4
text 71.1
jacket 66.3
black and white 57.4

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 100%
Sad 89.9%
Angry 5.5%
Disgusted 2.1%
Surprised 1.1%
Fear 0.5%
Confused 0.5%
Calm 0.3%
Happy 0.2%

AWS Rekognition

Age 39-47
Gender Male, 100%
Calm 44.1%
Sad 42.7%
Fear 4.5%
Surprised 4%
Disgusted 2.1%
Angry 1.2%
Confused 0.8%
Happy 0.6%

AWS Rekognition

Age 50-58
Gender Male, 99.9%
Surprised 69.2%
Happy 7.3%
Angry 7.2%
Confused 5.6%
Fear 4.2%
Sad 3.1%
Disgusted 2%
Calm 1.3%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Tie 99.7%
Person 99.3%
Suit 92.2%

Captions

Microsoft

a man wearing a suit and tie 96.4%
a man standing in front of a mirror posing for the camera 77.2%
a man wearing a suit and tie standing in front of a mirror 77.1%

Text analysis

Amazon

es