Human Generated Data

Title

Untitled (two men sitting on couch)
Date

1953
People

Artist: Peter James Studio, American

Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.20235

Human Generated Data

Title

Untitled (two men sitting on couch)

People

Artist: Peter James Studio, American

Date

1953

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-03-05

Clothing 99.7
Apparel 99.7
Shoe 99.3
Footwear 99.3
Person 96.5
Human 96.5
Person 95.4
Flooring 93.3
Overcoat 92.2
Coat 92.2
Sleeve 90.7
Floor 90.6
Sitting 87
Accessories 85.2
Accessory 85.2
Tie 85.2
Shoe 82.1
Wood 77.2
Long Sleeve 75.7
Suit 73.5
Shoe 71.4
Hardwood 63.7
Furniture 62
Chair 62
Shoe 61.3
Tuxedo 58
Plywood 57.2
Plant 55.3

Imagga
created on 2022-03-05

executive 66
man 51.8
male 46.1
person 45.5
adult 39.5
professional 35.9
businessman 34.5
people 33.5
teacher 31.5
office 31.5
business 29.8
men 26.6
desk 26.5
colleagues 25.3
happy 24.5
senior 24.4
mature 24.2
patient 24.1
sitting 24.1
working 22.1
laptop 22
indoors 22
businesspeople 21.8
casual 21.2
educator 21.1
smiling 21
meeting 20.7
computer 20.1
handsome 19.6
job 18.6
home 18.4
30s 18.3
indoor 18.3
lifestyle 17.4
table 17.3
smile 17.1
worker 17
entrepreneur 16.9
portrait 16.8
nurse 16.8
medical 16.8
corporate 16.3
elderly 16.3
room 15.8
work 15.7
team 15.2
suit 14.9
40s 14.6
businesswoman 14.6
group 14.5
hospital 14.5
looking 14.4
doctor 14.1
associates 13.8
coworkers 13.8
20s 13.8
horizontal 13.4
color 13.4
together 13.2
mid adult 12.6
health 12.5
coat 12.2
couple 12.2
standing 12.2
clinic 12.1
occupation 11.9
cheerful 11.4
face 11.4
women 11.1
inside 11.1
thirties 10.7
talking 10.5
case 10.3
happiness 10.2
alone 10.1
confident 10
modern 9.8
discussion 9.7
busy 9.6
four 9.6
lab coat 9.5
illness 9.5
sick person 9.5
career 9.5
manager 9.3
teamwork 9.3
camera 9.2
attractive 9.1
old 9.1
care 9.1
collaboration 8.9
to 8.9
25 30 years 8.8
businessmen 8.8
older 8.7
specialist 8.7
clothing 8.6
formal 8.6
tie 8.5
adults 8.5
classroom 8.4
medicine 7.9
boardroom 7.9
four people 7.9
bright 7.9
30 35 years 7.9
discussing 7.9
day 7.9
paper 7.8
50s 7.8
employee 7.8
clinical 7.8
education 7.8
middle aged 7.8
two people 7.8
concentration 7.7
jacket 7.7
retirement 7.7
life 7.7
twenties 7.6
serious 7.6
two 7.6
hand 7.6
house 7.5
keyboard 7.5
human 7.5
one 7.5
director 7.5
technology 7.4
focus 7.4
successful 7.3
board 7.2
black 7.2

Google
created on 2022-03-05

Photograph 94.3
Black 89.8
Black-and-white 86.2
Style 84.1
Line 82.9
Monochrome photography 77.7
Monochrome 76.4
Knee 75
Font 74.5
Snapshot 74.3
Sitting 71.7
Suit 70.1
Comfort 69.8
Room 69.5
Art 69
Rectangle 68.3
Vintage clothing 67.9
Stock photography 66.6
Boot 65.8
Uniform 63.2

Microsoft
created on 2022-03-05

text 99.3
person 97.6
wall 96
clothing 92.8
furniture 85.7
man 85.6
black and white 82.1
chair 50.2

Face analysis

Amazon

Google

AWS Rekognition

Age 51-59
Gender Male, 99.4%
Calm 86.2%
Surprised 7.5%
Sad 3.1%
Happy 1.4%
Disgusted 0.8%
Angry 0.5%
Confused 0.3%
Fear 0.2%

AWS Rekognition

Age 54-64
Gender Male, 98.6%
Calm 87.5%
Happy 10.8%
Surprised 0.6%
Disgusted 0.4%
Confused 0.3%
Sad 0.2%
Angry 0.2%
Fear 0.1%

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Shoe 99.3%
Person 96.5%
Tie 85.2%
Suit 73.5%

Captions

Microsoft

a man sitting on a bench 68.6%
a man sitting at a table with a racket 61.4%
a man and a woman sitting on a bench 44.4%

Text analysis

Amazon

EDI
YТ3A°-
Agencia
Con

Google

XAGON
YT37A°2-
YT37A°2- XAGON