Human Generated Data

Title

Diana L. Eck and Dorothy A. Austin, Faculty Deans

Date

2017

People

Artist: Stephen E. Coit, American born 1948

Sitter: Diana L. Eck,

Sitter: Mrs. Dorothy B. Austin,

Classification

Paintings

Credit Line

Harvard University Portrait Collection, Commissioned by Lowell House Faculty Deans, H866

Copyright

© Stephen E. Coit, AB 1971, MBA 1977

Human Generated Data

Title

Diana L. Eck and Dorothy A. Austin, Faculty Deans

People

Artist: Stephen E. Coit, American born 1948

Sitter: Diana L. Eck,

Sitter: Mrs. Dorothy B. Austin,

Date

2017

Classification

Paintings

Machine Generated Data

Tags

Amazon
created on 2022-05-03

Shelf 98.7
Furniture 98.5
Human 97.7
Person 97.7
Person 93.1
Plant 92.5
Flower 87.4
Flower Arrangement 87.4
Blossom 87.4
Art 81.8
Painting 81.8
Flower Bouquet 81.6
Couch 77.4
Accessories 77
Glasses 77
Accessory 77
Cabinet 75
Senior Citizen 74.3
Living Room 65.1
Indoors 65.1
Room 65.1
Pottery 61.4
Jar 60
Vase 60
Bookcase 58.9
China Cabinet 55.5

Imagga
created on 2022-05-03

man 40.3
people 36.3
male 35.9
grandfather 33.5
senior 32.8
happy 32
couple 30.5
family 30.3
hairdresser 30
lifestyle 28.2
home 27.9
person 27.5
grandma 27.3
adult 26.9
together 25.4
monk 25.3
mature 24.2
smiling 23.2
elderly 23
happiness 22.7
sitting 21.5
portrait 21.4
indoors 21.1
retirement 20.2
smile 19.2
old 18.8
love 18.2
two 17.8
grandmother 16.6
retired 16.5
cheerful 16.3
husband 16.2
casual 16.1
child 15.7
room 13.9
couch 13.5
father 13.5
boy 13
men 12.9
mother 12.7
salon 12.5
wife 12.3
fun 12
attractive 11.9
son 11.6
indoor 11
handsome 10.7
face 10.7
lady 10.6
enjoying 10.4
looking 10.4
women 10.3
aged 10
daughter 9.8
kid 9.8
interior 9.7
four 9.6
sofa 9.6
table 9.5
hair 9.5
talking 9.5
expression 9.4
restaurant 9.2
pretty 9.1
70s 8.9
life 8.8
older 8.7
work 8.6
age 8.6
togetherness 8.5
joy 8.4
professional 8.3
alcohol 8.3
wine 8.3
medical 7.9
business 7.9
color 7.8
parent 7.7
married 7.7
fashion 7.5
drink 7.5
friends 7.5
relationship 7.5
care 7.4
occupation 7.3
children 7.3
executive 7.2
kin 7.2
romantic 7.1
dinner 7.1
dad 7.1
to 7.1

Google
created on 2022-05-03

Outerwear 95.5
Organ 90.6
Human 89.2
Window 89
Fashion 88
Vision care 87.7
Comfort 85
Smile 83.2
People 79.7
Chair 79.1
Jacket 78.4
Picture frame 75.4
Eyewear 74.9
Snapshot 74.3
Fun 74.3
Event 73.4
Lap 73.3
Happy 72.5
Blond 70.1
Sitting 69.8

Microsoft
created on 2022-05-03

person 99
indoor 96.5
human face 91.8
clothing 90
smile 87.6
text 67.4
flower 58.7

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 57-65
Gender Female, 100%
Happy 81.1%
Confused 9%
Surprised 7.9%
Fear 6.1%
Calm 3.7%
Sad 2.4%
Disgusted 0.9%
Angry 0.9%

AWS Rekognition

Age 57-65
Gender Female, 100%
Calm 97.5%
Surprised 6.3%
Fear 5.9%
Sad 2.3%
Happy 1.4%
Confused 0.2%
Disgusted 0.2%
Angry 0.1%

Microsoft Cognitive Services

Age 71
Gender Female

Microsoft Cognitive Services

Age 68
Gender Female

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Possible
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 97.7%
Painting 81.8%
Glasses 77%

Captions

Microsoft

a man and a woman taking a selfie 32.7%
a person sitting on a table 32.6%
a man and a woman sitting on a table 29.5%

Text analysis

Amazon

-INDIA

Google

INDIA
INDIA