Human Generated Data

Title

W. Family (Composer, Doctor), Berlin (GDR)

Date

1983

People

Artist: Christian Borchert, German 1942 - 2000

Classification

Photographs

Credit Line

Harvard Art Museums/Busch-Reisinger Museum, Antonia Paepcke DuBrul Fund, 2018.215

Copyright

© Estate of Christian Borchert

Human Generated Data

Title

W. Family (Composer, Doctor), Berlin (GDR)

People

Artist: Christian Borchert, German 1942 - 2000

Date

1983

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-07-20

Piano 99.8
Musical Instrument 99.8
Leisure Activities 99.8
Person 99.4
Human 99.4
Grand Piano 97.4
Person 94.5
Furniture 94.1
Person 89.8
Indoors 86.3
Person 82.2
Room 82
Chair 59.9
Bookcase 59.5
Living Room 57.1
Library 55.3
Book 55.3

Clarifai
created on 2019-07-20

people 99.9
piano 99.7
furniture 98.4
adult 98.3
one 98.2
music 98.1
two 97.4
instrument 97.2
musician 97
room 96.1
child 96
pianist 95.4
wear 94.6
woman 94.4
seat 94.3
chair 94
sit 91.4
education 90
group 89
indoors 88.5

Imagga
created on 2019-07-20

musical instrument 74.5
piano 71.4
stringed instrument 66.1
percussion instrument 61
keyboard instrument 52
upright 47.6
sitting 24.9
bowed stringed instrument 24.5
grand piano 24.3
people 24
man 23.5
indoors 22.8
male 22.7
violin 21.8
table 21.7
home 20.7
person 20.1
smiling 19.5
chair 18.5
room 18.4
happy 17.5
teacher 17.4
lifestyle 17.3
adult 17.2
education 16.4
music 15.6
marimba 14.6
cheerful 14.6
classroom 14.6
business 14.6
women 14.2
happiness 14.1
keyboard 14.1
together 14
mature 13.9
computer 13.6
interior 13.3
boy 13
portrait 12.3
desk 12.3
senior 12.2
indoor 11.9
professional 11.4
school 11.3
office 11.2
work 11.2
old 11.1
laptop 10.9
family 10.7
businessman 10.6
instrument 10.2
playing 10
smile 10
student 10
attractive 9.8
black 9.6
couple 9.6
talking 9.5
businesspeople 9.5
love 9.5
men 9.4
child 9.4
two 9.3
communication 9.2
inside 9.2
modern 9.1
handsome 8.9
technology 8.9
group 8.9
colleagues 8.7
class 8.7
play 8.6
musical 8.6
sit 8.5
cello 8.5
mother 8.5
meeting 8.5
learning 8.5
enjoyment 8.4
suit 8.1
kid 8
working 8
teaching 7.8
color 7.8
two people 7.8
practice 7.7
studying 7.7
casual 7.6
learn 7.6
horizontal 7.5
accordion 7.5
fun 7.5
leisure 7.5
holding 7.4
phone 7.4
back 7.3
children 7.3
scholar 7.2
educator 7.2
seat 7.2
job 7.1
device 7.1
furniture 7

Google
created on 2019-07-20

Standing 80.9
Room 71.4
Black-and-white 68.3
Sitting 66.1
Monochrome 60.1
Pianist 58.4
Furniture 53.3

Microsoft
created on 2019-07-20

person 97.4
sitting 96.5
piano 95.1
furniture 82.2
black and white 81.3
book 59.4
musical keyboard 54.6

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Female, 60.4%
Confused 0.4%
Surprised 0.3%
Happy 0.3%
Calm 98.2%
Disgusted 0.1%
Sad 0.4%
Angry 0.3%

AWS Rekognition

Age 4-7
Gender Female, 99.6%
Confused 14.6%
Calm 17.3%
Angry 4.6%
Surprised 18.1%
Sad 10.1%
Happy 33%
Disgusted 2.3%

AWS Rekognition

Age 57-77
Gender Male, 98.2%
Calm 97.3%
Disgusted 0.2%
Surprised 0.4%
Confused 0.5%
Happy 0.7%
Angry 0.3%
Sad 0.7%

Microsoft Cognitive Services

Age 68
Gender Male

Microsoft Cognitive Services

Age 32
Gender Female

Microsoft Cognitive Services

Age 0
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Piano 99.8%
Person 99.4%

Captions

Microsoft

a man and a woman sitting on a bench 76.5%
a person sitting on a bench 76.4%
a man and woman sitting on a bench 71.1%

Text analysis

Google

UTW
UTW MAAAA
MAAAA