Human Generated Data

Title

Untitled (couple at piano with dog)
Date

1970s
People

Artist: Curtis Studio, American active 1891 - 1935
Classification

Photographs
Credit Line

Harvard Art Museums/Fogg Museum, Transfer from the Carpenter Center for the Visual Arts, American Professional Photographers Collection, 4.2002.1036

Human Generated Data

Title

Untitled (couple at piano with dog)

People

Artist: Curtis Studio, American active 1891 - 1935

Date

1970s

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2022-02-26

Person 99.7
Human 99.7
Performer 99.3
Person 99
Musician 98.5
Musical Instrument 98.5
Leisure Activities 97.6
Grand Piano 97.6
Piano 97.6
Pianist 96.6
Gown 92.5
Robe 92.5
Apparel 92.5
Evening Dress 92.5
Fashion 92.5
Clothing 92.5
Person 72.3

Imagga
created on 2022-02-26

man 39
male 32.6
people 31.8
adult 27.1
senior 26.2
person 26
happy 25.1
smiling 23.1
couple 22.6
sitting 20.6
lifestyle 20.2
home 19.9
together 18.4
elderly 18.2
indoors 17.6
men 17.2
room 17.2
family 16.9
portrait 16.8
happiness 16.4
group 16.1
table 16
holding 15.7
dog 15.1
professional 15
indoor 14.6
pooch 14.5
teacher 14.2
hairdresser 14.1
hunting dog 13.6
smile 13.5
love 13.4
office 13.2
child 13.2
mature 13
desk 12.6
handsome 12.5
businessman 12.4
business 12.1
education 12.1
looking 12
two 11.9
old 11.8
color 11.7
cheerful 11.4
adults 11.4
boy 11.3
classroom 11
student 10.9
patient 10.7
spaniel 10.6
couch 10.6
meeting 10.4
friends 10.3
black 10.2
occupation 10.1
friendly 10.1
suit 10
hospital 10
terrier 10
care 9.9
school 9.9
attractive 9.8
kid 9.7
fun 9.7
health 9.7
husband 9.5
women 9.5
youth 9.4
relationship 9.4
chair 9.3
20s 9.2
father 9.1
team 9
job 8.8
medical 8.8
standing 8.7
class 8.7
casual 8.5
doctor 8.5
enjoyment 8.4
cocker spaniel 8.4
hand 8.4
leisure 8.3
joyful 8.3
cup 8.1
board 8.1
mother 8.1
work 7.8
hands 7.8
lesson 7.8
retired 7.8
mid adult 7.7
retirement 7.7
sofa 7.7
sporting dog 7.6
executive 7.5
guy 7.5
computer 7.4
teamwork 7.4
confident 7.3
aged 7.2
working 7.1
nurse 7
restaurant 7

Google
created on 2022-02-26

Dog 92.6
Fashion 88.1
Flash photography 87.3
Dress 85.1
Style 83.8
Picture frame 81.8
Chair 81.2
Vintage clothing 76
Classic 72.9
Formal wear 72
Table 70.8
Event 70.7
Art 69.6
Jewellery 69.5
Companion dog 69.4
Room 68.9
Suit 67.5
Sitting 67.4
Fashion design 65.6
Monochrome photography 63.4

Microsoft
created on 2022-02-26

dog 99.4
person 97
text 93.8
indoor 92.3
carnivore 79.9
clothing 68.1
posing 41.2

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 53-61
Gender Male, 100%
Calm 97.2%
Confused 1.5%
Happy 0.6%
Angry 0.2%
Sad 0.1%
Surprised 0.1%
Disgusted 0.1%
Fear 0%

AWS Rekognition

Age 52-60
Gender Female, 100%
Calm 95.3%
Happy 2.7%
Sad 0.4%
Confused 0.4%
Surprised 0.3%
Angry 0.3%
Fear 0.3%
Disgusted 0.2%

Microsoft Cognitive Services

Age 57
Gender Male

Microsoft Cognitive Services

Age 51
Gender Female

Microsoft Cognitive Services

Age 27
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Likely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.7%

Captions

Microsoft

a person holding a dog posing for the camera 92.8%
a person and a dog posing for the camera 92.7%
a person holding a dog 88.9%