Human Generated Data

Title

Elizabeth W. Vorenberg (b. 1930) and James Vorenberg (b. 1928)
Date

1981
People

Artist: Barbara Swan, American 1922 - 2003

Sitter: Prof. James Vorenberg, 1928 - 2000

Sitter: Elizabeth W. Vorenberg, born 1930
Classification

Paintings
Credit Line

Harvard University Portrait Collection, Gift of friends of Dunster House, 1981, H677
Copyright

© Barbara Swan

Human Generated Data

Title

Elizabeth W. Vorenberg (b. 1930) and James Vorenberg (b. 1928)

People

Artist: Barbara Swan, American 1922 - 2003

Sitter: Prof. James Vorenberg, 1928 - 2000

Sitter: Elizabeth W. Vorenberg, born 1930

Date

1981

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2019-04-19

Person 99.3
Human 99.3
Person 96.7
Art 96.5
Accessories 95.4
Accessory 95.4
Tie 95.4
Sitting 90.7
Painting 78.1
Drawing 76.1
Wood 72.8
Senior Citizen 57.9
Sketch 56.9

Clarifai
created on 2019-04-19

people 99.5
adult 99.2
two 99.2
man 98.2
facial expression 97.1
wear 96.8
one 95.7
affection 93.2
portrait 92.8
sit 92.3
woman 92.1
seat 90.1
furniture 88.3
facial hair 85.3
leader 84.3
elderly 84.2
indoors 84.1
three 82.5
interaction 78
outerwear 77.4

Imagga
created on 2019-04-19

grandma 100
senior 52.5
mature 41.9
elderly 40.3
home 37.5
retired 35.9
couple 34.9
male 34.1
people 34.1
person 33.3
man 33
happy 31.4
family 30.3
old 30
adult 29.8
retirement 28.8
husband 26.7
wife 24.7
indoors 24.6
smiling 24.6
portrait 24.6
together 24.6
sitting 24.1
lifestyle 23.9
mother 21
older 20.4
looking 20
love 19.7
aged 19
pensioner 19
smile 17.1
relaxed 16
grandfather 15.6
couch 15.5
happiness 14.9
casual 14.4
grandmother 13.7
women 13.5
sofa 13.4
camera 13
70s 12.8
middle aged 12.7
gray 12.6
affection 12.6
handsome 12.5
medical 12.4
hair 11.9
health 11.8
patient 11.8
two people 11.7
loving 11.5
clothing 11.4
lady 11.4
glasses 11.1
horizontal 10.9
daughter 10.9
caring 10.8
60s 10.8
affectionate 10.7
married 10.6
modern 10.5
human 10.5
age 10.5
kin 10.5
relationship 10.3
room 10
relaxing 10
face 10
gray hair 9.9
seniors 9.8
attractive 9.8
illness 9.5
father 9.3
joy 9.2
holding 9.1
blond 9
cheerful 8.9
hug 8.7
30s 8.7
aging 8.6
men 8.6
bathrobe 8.5
two 8.5
doctor 8.5
hand 8.4
care 8.2
indoor 8.2
hospital 8
seventies 7.9
parents 7.8
bonding 7.8
color 7.8
pretty 7.7
expression 7.7
talking 7.6
child 7.6
togetherness 7.6
house 7.5
fun 7.5
one 7.5
parent 7.3
romance 7.2
to 7.1
day 7.1

Google
created on 2019-04-19

Sitting 88.6
Gentleman 80.8
Drawing 80.5
Portrait 74.2
Art 70.9
Sketch 69
Painting 63
Visual arts 55
Vintage clothing 54.7
Retro style 53.4
Artwork 53.4

Microsoft
created on 2019-04-19

wall 99
sitting 98.9
person 98.7
posing 79.1
old 46

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 35-52
Gender Male, 99.5%
Happy 12.9%
Disgusted 1.7%
Surprised 2.1%
Angry 3.3%
Calm 32.4%
Sad 30.2%
Confused 17.4%

AWS Rekognition

Age 26-43
Gender Female, 99.9%
Disgusted 2.7%
Confused 2.4%
Calm 6.5%
Angry 1.1%
Surprised 1.2%
Happy 74.6%
Sad 11.4%

Microsoft Cognitive Services

Age 55
Gender Male

Microsoft Cognitive Services

Age 49
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.3%
Tie 95.4%

Captions

Microsoft

a group of people sitting posing for the camera 97.7%
a couple of people sitting posing for the camera 96.1%
a group of people posing for a photo 96%