Human Generated Data

Title

Untitled (group photograph, standing from left to right, Col. Murray; Lady Filmer; Col. Steele; Sir Edmund Filmer; seated from left to right, Miss Murray; Major Alison; Lady Agnes(?) Murray; Lord Tyrone; verso: eleven names not related to the group photograph recto)

Date

1862-1888

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Classification

Photographs

Credit Line

Harvard Art Museums/Fogg Museum, Purchase through the generosity of Melvin R. Seiden, P1982.359.49

Human Generated Data

Title

Untitled (group photograph, standing from left to right, Col. Murray; Lady Filmer; Col. Steele; Sir Edmund Filmer; seated from left to right, Miss Murray; Major Alison; Lady Agnes(?) Murray; Lord Tyrone; verso: eleven names not related to the group photograph recto)

People

Artist: Mary Georgiana Caroline Cecil Filmer, British 1838-1903

Date

1862-1888

Classification

Photographs

Machine Generated Data

Tags

Amazon
created on 2019-04-05

Person 99.2
Human 99.2
Person 98.8
Person 98.7
Person 98.6
Person 98.5
Person 97.8
Person 97
People 94
Person 92.4
Art 86.5
Painting 86.5
Family 81.7
Advertisement 68.8
Clothing 64.4
Apparel 64.4

Clarifai
created on 2018-04-19

people 100
group 99.5
adult 99.4
man 98
leader 97.9
two 97.8
print 97.1
wear 96.7
woman 95.5
portrait 94.8
administration 94.3
furniture 94.3
sit 93
art 92.8
three 92.8
lithograph 92.7
four 92.5
monarch 92.5
illustration 91.5
seat 91

Imagga
created on 2018-04-19

money 43.4
tray 40.3
cash 38.4
finance 36.3
brass 35.2
currency 35
laptop 32.7
receptacle 32.6
dollar 31.5
memorial 28.2
portable computer 27.8
financial 27.6
vintage 26.5
container 26.1
bank 26
business 25.5
paper 24.3
wealth 24.2
dollars 24.1
structure 24
old 23.7
banking 23
retro 22.9
bill 22.8
personal computer 20.9
one 20.2
savings 19.6
hundred 19.4
pay 19.2
stamp 18.5
symbol 18.2
close 17.7
letter 17.4
rich 16.8
note 16.5
mail 16.3
envelope 15.6
banknote 15.5
us 15.4
postmark 14.8
exchange 14.3
digital computer 13.9
ancient 13.8
chalkboard 13.7
success 12.9
funds 12.7
banknotes 12.7
states 12.6
finances 12.5
closeup 12.1
grunge 11.9
investment 11.9
art 11.9
message 11.9
binding 11.9
circa 11.8
postage 11.8
aged 11.8
bills 11.7
loan 11.5
post 11.4
economy 11.1
postal 10.8
icon 10.3
card 10.2
shows 9.8
franklin 9.8
printed 9.8
market 9.8
texture 9.7
black 9.6
price 9.6
profit 9.6
board 9.5
commerce 9.3
head 9.2
face 9.2
idea 8.9
blackboard 8.9
philately 8.9
computer 8.8
object 8.8
payment 8.7
notes 8.6
book 8.6
billboard 8.4
concepts 8
value 7.8
monitor 7.7
wall 7.7
change 7.7
england 7.6
united 7.6
save 7.6
sign 7.5
buy 7.5
man 7.4
global 7.3
school 7.2

Google
created on 2018-04-19

Microsoft
created on 2018-04-19

text 100
book 99.7
old 92.6
person 86.7
posing 76.3
people 61.6
vintage 40.4

Face analysis

Amazon

Microsoft

Google

AWS Rekognition

Age 30-47
Gender Male, 54.9%
Confused 45.3%
Disgusted 45.1%
Surprised 45.4%
Calm 51.7%
Happy 45.3%
Sad 46.2%
Angry 45.9%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Angry 45.7%
Calm 52.8%
Disgusted 45.1%
Sad 45.6%
Surprised 45.3%
Confused 45.4%
Happy 45.2%

AWS Rekognition

Age 35-52
Gender Male, 94.5%
Happy 1.5%
Surprised 1.2%
Sad 8.4%
Disgusted 1.6%
Angry 2.8%
Calm 82.5%
Confused 2%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Surprised 45%
Angry 45.5%
Disgusted 45.1%
Sad 45%
Confused 45.1%
Happy 45%
Calm 54.3%

AWS Rekognition

Age 35-52
Gender Male, 54.9%
Disgusted 45.1%
Sad 45.7%
Confused 45.5%
Angry 45.9%
Calm 52.3%
Happy 45.1%
Surprised 45.3%

AWS Rekognition

Age 35-52
Gender Male, 54.7%
Surprised 45.5%
Angry 45.5%
Sad 45.4%
Happy 45.4%
Disgusted 45.7%
Confused 45.5%
Calm 52.1%

AWS Rekognition

Age 26-44
Gender Male, 54.5%
Disgusted 45.1%
Surprised 45.1%
Sad 45.1%
Calm 54.4%
Angry 45.1%
Confused 45.2%
Happy 45%

AWS Rekognition

Age 19-36
Gender Female, 50.6%
Happy 45%
Angry 45.1%
Confused 45.1%
Calm 54.5%
Surprised 45.1%
Disgusted 45%
Sad 45.2%

Microsoft Cognitive Services

Age 39
Gender Male

Microsoft Cognitive Services

Age 46
Gender Male

Microsoft Cognitive Services

Age 30
Gender Male

Microsoft Cognitive Services

Age 38
Gender Male

Microsoft Cognitive Services

Age 35
Gender Male

Microsoft Cognitive Services

Age 42
Gender Male

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Likely
Blurred Very unlikely

Google Vision

Surprise Very unlikely
Anger Very unlikely
Sorrow Very unlikely
Joy Very unlikely
Headwear Very unlikely
Blurred Very unlikely

Feature analysis

Amazon

Person 99.2%
Painting 86.5%

Captions

Microsoft

a vintage photo of a group of people sitting posing for the camera 88.5%
a vintage photo of a group of people posing for the camera 88.4%
a vintage photo of a group of people posing for a picture 88.3%

Text analysis

Amazon

.
uit
Co.
Saneund
Sticle..
Rime
Co. merag. olady RIme. . Sticle.. Ser Saneund Rime
merag.
Rurrav
aliin
RIme.
Ser
uit Rurrav ai aliin aw Linoe
olady
Linoe
ai
aw